-- Logs begin at Mon 2022-09-05 11:34:02 UTC, end at Mon 2022-09-05 12:47:53 UTC. -- Sep 05 12:10:19.735999 dv-cinder-855189-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 05 12:10:19.745474 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 05 12:10:19.748161 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 5 12:10:19 2022] *** Sep 05 12:10:19.748161 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 05 12:10:19.748161 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 05 12:10:19.748161 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: nodename: dv-cinder-855189-1-iscsi Sep 05 12:10:19.748161 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: machine: x86_64 Sep 05 12:10:19.748161 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: clock source: unix Sep 05 12:10:19.748161 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: pcre jit disabled Sep 05 12:10:19.748161 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: detected number of CPU cores: 4 Sep 05 12:10:19.748161 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: current working directory: / Sep 05 12:10:19.748161 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: detected binary path: /usr/bin/uwsgi-core Sep 05 12:10:19.748161 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: your processes number limit is 47680 Sep 05 12:10:19.748161 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: your memory page size is 4096 bytes Sep 05 12:10:19.749055 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: detected max file descriptor number: 2048 Sep 05 12:10:19.749055 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: lock engine: pthread robust mutexes Sep 05 12:10:19.749055 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: thunder lock: enabled Sep 05 12:10:19.749055 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 05 12:10:19.749055 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 05 12:10:19.788269 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: Python main interpreter initialized at 0x5617a5d0a9c0 Sep 05 12:10:19.788269 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: python threads support enabled Sep 05 12:10:19.788269 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: your server socket listen backlog is limited to 100 connections Sep 05 12:10:19.788269 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: your mercy for graceful operations on workers is 90 seconds Sep 05 12:10:19.788696 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: mapped 403077 bytes (393 KB) for 2 cores Sep 05 12:10:19.788696 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: *** Operational MODE: preforking *** Sep 05 12:10:19.788992 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: *** uWSGI is running in multiple interpreter mode *** Sep 05 12:10:19.788992 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: spawned uWSGI master process (pid: 105547) Sep 05 12:10:19.789255 dv-cinder-855189-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 05 12:10:19.790252 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: spawned uWSGI worker 1 (pid: 105548, cores: 1) Sep 05 12:10:19.790252 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: spawned uWSGI worker 2 (pid: 105549, cores: 1) Sep 05 12:10:19.790252 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 05 12:10:20.449784 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 12:10:20.472220 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 12:10:21.539617 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:10:21.539617 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: from cryptography.utils import int_from_bytes Sep 05 12:10:21.540304 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:10:21.540304 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: from cryptography.utils import int_from_bytes Sep 05 12:10:21.546841 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:10:21.546841 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: from cryptography.utils import int_from_bytes Sep 05 12:10:21.547414 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:10:21.547414 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: from cryptography.utils import int_from_bytes Sep 05 12:10:24.055268 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 12:10:24.056278 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 12:10:24.056278 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 12:10:24.056677 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 12:10:24.056993 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 12:10:24.057259 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 12:10:24.057912 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.058060 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 12:10:24.058208 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.058363 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 12:10:24.058517 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.058677 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 12:10:24.058829 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 12:10:24.058975 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.059175 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.059348 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.059505 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.059746 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.059853 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.060153 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.060244 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.060491 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.060622 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.060810 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.061100 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.061198 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.061461 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.061610 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.061892 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.062158 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.062376 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855189-1-iscsi {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.062567 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.062736 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.062944 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.063155 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855189-1-iscsi {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.063396 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.063627 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.063829 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.064063 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.064272 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.064486 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.064793 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.064991 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.065212 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.065212 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.065578 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.065814 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.067937 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.068145 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.068371 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.068587 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.068786 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.068982 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.069174 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.069375 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.069571 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.069770 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.069975 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.070171 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.070171 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.070564 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.070758 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.070758 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.071128 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.071311 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.071503 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.071741 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.071936 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.072128 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855189-1-iscsi {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.072128 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.072801 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.072995 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.073176 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.073368 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.073368 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.073754 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855189-1-iscsi {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.073950 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.073950 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.074313 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.074545 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.074750 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.074955 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.074955 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.075342 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.075586 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.075586 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.075951 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.076145 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.076338 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.076561 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.076764 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.076962 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.076962 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.077337 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.077550 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.077752 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.077946 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.078137 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.078330 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.078330 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.078711 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.078922 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.079113 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.079309 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.079309 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.079714 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.079921 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.080124 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.080319 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.080515 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.080709 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.080709 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.081086 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.081278 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.081465 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.081653 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.081803 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.081940 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.082064 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.082187 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.082187 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.082437 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.082669 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.082806 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.082939 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.083063 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.083194 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.083325 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.083464 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.083464 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.083732 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.083857 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.084004 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.084167 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.084304 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.084437 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.084565 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.084689 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.084823 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.084961 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.084961 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.085194 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.085335 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.085531 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.085721 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.085919 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.086110 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.086110 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.086394 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.086528 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.086652 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.086784 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.086909 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.087022 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.087022 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.087246 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.087375 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.087508 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.087651 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.087821 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.088027 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.088216 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.088415 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.088415 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.088747 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.088891 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.088891 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.089246 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.089943 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.090157 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.090356 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.090356 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.090753 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.090955 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.091129 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.091258 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.091432 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.091727 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.091727 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.092105 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.092334 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.092535 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.092907 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.093110 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.093321 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.093321 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.093731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.093935 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.094133 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.094334 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.094334 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.094731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.094937 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.095146 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.095350 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.095581 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.095784 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.096005 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.096219 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.096420 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.096617 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.096617 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.097073 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.097282 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.097483 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.097682 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.097885 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.098083 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.098285 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.098510 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.098510 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.098885 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.099089 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.099282 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.099460 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.099741 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.099955 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.100172 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.100384 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.100583 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.100783 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.100783 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.101136 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.101334 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.101523 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.101706 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.101920 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.102135 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.102135 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.102523 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.102725 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.103112 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.103432 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.103678 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.103889 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.104076 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.104279 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.104279 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.104738 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.104937 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.105184 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.105863 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.106066 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.106266 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.106266 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.106719 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.106976 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.107189 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.107391 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.107774 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.107980 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.108180 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.108396 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.108396 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.108820 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.109036 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.109266 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.109488 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.109691 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.109905 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.110105 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.110318 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.110529 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.110746 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.111054 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.111256 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.111256 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.111683 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.111890 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.112093 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.112295 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.112495 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.112697 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.113031 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.113370 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.113370 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.113755 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.113990 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.114193 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.114394 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.114614 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.114815 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.114815 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.115194 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.115407 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.115686 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.115880 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.116082 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.116283 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.116283 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.116679 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.116874 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.117075 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.117277 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.117489 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.117742 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.117970 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.118186 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.118388 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.118586 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.118785 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.118988 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.119212 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.119414 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.119639 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.119639 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.120046 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.120046 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.120460 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.120770 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.120968 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.121169 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.121372 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.121663 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.121877 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.122079 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.122274 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.122475 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.122475 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.122879 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:24.123083 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.123310 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.123694 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.123886 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.124104 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.124104 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.124490 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.124701 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.124920 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.125132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.125334 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.125552 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.125552 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.125945 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.126150 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.126350 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.126545 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.126760 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.126961 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.127167 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.127369 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.127369 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.127862 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.128066 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.128270 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.128468 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.128681 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.128880 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.129094 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.129292 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.129503 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.129706 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.129706 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.130097 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.130309 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.130517 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.130717 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.130929 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.131130 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.131130 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.131545 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.131753 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.131947 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.131947 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.132329 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.132517 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.132718 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.132918 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.133087 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.133087 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.133350 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.133582 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.133824 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.133953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.134079 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.134202 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.134325 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.134463 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.134463 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.134686 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.134820 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.134945 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.135068 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.135199 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.135325 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.135325 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.135596 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.135735 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.135871 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.135996 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.136119 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.136242 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.136242 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.137021 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.137155 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.137279 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.137393 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.137515 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.137638 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.137751 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.137851 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.137851 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.137994 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.138067 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.138145 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.138226 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.138315 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.138390 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.138468 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.138548 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.138626 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.138729 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.138729 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.138871 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.138945 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.139030 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.139109 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.139199 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.139280 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.139360 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.139440 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.139440 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.139638 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.139730 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.139813 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.139893 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.139979 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.140055 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.140055 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.140203 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.140289 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.140368 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.140490 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.140590 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.140672 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.140672 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.140818 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.140896 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.140969 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.141047 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.141131 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.141211 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.141211 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.141345 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.141430 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.141504 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.141587 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.141674 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.141748 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.141748 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.141885 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.141957 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.141957 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.142117 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.142207 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.142287 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.142360 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.142360 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.142515 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.142589 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.142589 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.142719 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.142792 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.142792 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.142921 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.142993 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.143064 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.143144 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.143144 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.143290 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.143368 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.143368 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.143508 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.143611 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.143611 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.143757 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.143851 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.143851 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.143992 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.144063 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.144147 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.144235 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.144235 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.144381 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.144454 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.144635 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.144809 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.144939 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.145231 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.145461 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.145559 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.145700 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.145856 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.146127 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.146220 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.146469 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.146562 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.146791 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.146994 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.147103 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.147426 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.147508 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.147765 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.147989 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.148093 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.148391 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.148484 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.148713 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.148848 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.149021 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.149300 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.149451 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.149664 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.149801 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.149999 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.150150 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.150320 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.150614 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.150776 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.150950 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.151087 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.151265 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.151545 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.151687 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.151970 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.152615 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.152773 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.153090 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.153236 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.153404 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.153646 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.153792 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.154024 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.154172 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.154323 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.154529 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.154690 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.154974 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.155380 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.155676 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.155816 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.155951 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.156112 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.156249 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.156429 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.156631 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.156769 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.157059 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.157200 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.157382 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.157536 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.157707 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.157993 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.158149 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.158312 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.158460 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.158726 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.158874 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.159018 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.159235 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.159384 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.159563 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.159759 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.159898 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.160183 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.160324 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.160500 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.160656 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.160803 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.161049 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.161191 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.161422 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.161558 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.161717 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.161965 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.162120 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.162345 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.162492 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.162656 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.162903 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.163052 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.163275 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.163414 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.163603 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.163911 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.164060 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.164203 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.164386 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.164536 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.164821 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.164960 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.165168 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.165317 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.165451 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.165754 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.165840 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.166064 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.166197 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.166372 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.166646 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.166733 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.166994 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.167088 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.167469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.167641 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.167990 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.168086 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.168316 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.168500 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.168645 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.168964 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.169058 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.169319 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.169430 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.169656 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.169838 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.170005 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.170306 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.170473 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.170643 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.170861 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.171020 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.171229 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.171443 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.171650 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.171865 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.172059 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.172216 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.172478 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.172642 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.172791 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.173088 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.173294 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.173437 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.173636 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.173779 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.173989 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.174191 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.174351 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.174599 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.174745 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.175081 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.175217 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.175302 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.175720 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.175854 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.175994 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.176120 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.176243 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.176451 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.176578 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.176758 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.176886 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.177064 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.177275 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.177477 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.177686 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.177885 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.178068 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.178240 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.178434 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.178642 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.178837 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.179037 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.179242 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.179446 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.179682 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.179682 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.180048 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.180240 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.180435 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.180626 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.180834 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.181031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.181031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.181427 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.181558 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.181683 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.181816 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.181941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.182066 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.182066 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.182306 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.182437 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.182571 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.182697 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.182819 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.182942 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.183276 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.183442 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.183657 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.183787 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.183992 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.184147 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.184308 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.184546 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.184675 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.184910 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.185037 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.185226 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.185353 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.185540 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.185794 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.185930 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.186144 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.186280 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.186447 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.186583 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.186769 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.186897 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.187077 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.187277 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.187414 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.187705 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.187834 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.188017 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.188143 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.188331 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.188575 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.188703 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.188956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.189092 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.189273 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.189394 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.189604 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.189771 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.189899 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.190155 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.190283 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.190474 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.190609 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.190782 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.190969 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.191105 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.191349 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.191486 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.191742 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.191869 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.192052 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.192179 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.192368 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.192582 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.192711 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.192970 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.193098 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.193276 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.193402 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.193589 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.193752 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.193895 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.194189 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.194324 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.194496 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.194632 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.194804 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.194981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.195108 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.195368 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.195504 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.195754 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.195895 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.196129 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.196255 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.196379 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.196637 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.196775 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.196986 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.197113 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.197294 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.197422 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.197661 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.197790 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.197971 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.198150 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.198276 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.198601 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.198746 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.199483 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.199632 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.199826 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.200045 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.200182 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.200441 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.200569 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.200762 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.200889 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.201097 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.201233 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.201444 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.201633 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.201772 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.202095 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.202230 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.202455 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.202773 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.202975 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.203105 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.203394 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.203585 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.203821 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.204116 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.204245 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.204476 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.204601 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.204793 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.204957 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.205096 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.205354 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.205498 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.205714 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.205832 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.206029 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.206300 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.206437 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.206587 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.206714 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.207036 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.207176 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.207377 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.207646 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.207777 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.208026 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.208152 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.208346 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.208486 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.208660 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.208871 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.208999 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.209272 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.209410 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.209588 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.209726 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.209896 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.210067 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.210195 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.210464 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.210592 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.210804 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.210929 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.211119 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.211256 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.211594 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.211728 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.211913 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.212053 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.212229 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.212420 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.212549 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.212802 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.212930 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.213145 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.213284 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.213468 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.213596 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.213792 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.214006 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.214143 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.214516 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.215152 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.215377 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.215505 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.215720 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.215859 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.216039 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.216361 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.216500 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.216626 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.216749 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.216947 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.217084 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.217275 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.217482 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.217610 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.217881 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.218009 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.218193 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.218321 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.218521 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.218734 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.218854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.219146 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.219273 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.219594 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.219740 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.219916 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.220042 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.220228 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.220363 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.220649 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.220778 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.220974 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.221100 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.221316 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.221469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.221606 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.221856 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.221985 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.222236 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.222371 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.222549 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.222676 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.222871 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.222998 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.223186 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.223374 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.223503 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.223796 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.223925 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.224160 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.224298 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.224483 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.224639 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.224795 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.225100 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.225237 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.225468 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.225602 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.225809 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.226018 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.226148 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.226556 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.226711 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.226938 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.227067 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.227257 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.227446 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.227613 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.227877 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.228006 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.228228 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.228353 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.228540 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.228676 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.228857 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.229125 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.229254 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.229467 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.229593 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.229796 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.229924 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.230288 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.230421 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.230615 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.230743 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.230935 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.231095 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.231257 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.231489 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.231697 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.231894 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.232021 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.232223 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.232352 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.232533 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.232695 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.232861 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.233078 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.233206 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.233465 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.233602 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.233815 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.233950 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.234126 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.234286 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.234452 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.234645 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.234772 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.235066 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.235200 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.235380 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.235513 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.235716 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.235926 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.236053 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.236474 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.236717 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.236832 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.236939 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.237065 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.237333 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.237448 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.237652 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.237849 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.237991 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.238279 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.238367 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.238640 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.238767 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.238955 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.239082 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.239276 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.239579 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.239714 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.239933 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.240058 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.240241 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.240370 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.240556 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.240727 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.240855 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.241115 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.241251 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.241460 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.242000 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.242120 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.242226 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.242334 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.242449 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.242566 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.242674 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.242780 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.243011 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.243156 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.243340 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.243733 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.243960 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.244086 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.244351 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.244465 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.244662 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.244911 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.245034 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.245308 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.245431 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.245617 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.245906 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.246028 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.246288 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.246402 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.246663 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.246935 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.247051 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.247255 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.247501 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.247631 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.247905 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.248126 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.248241 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.248529 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.248690 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.248849 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.249162 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.249289 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.249482 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.249800 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.249913 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.250120 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.250346 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.250707 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.250911 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.251056 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.251317 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.251454 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.251695 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.251832 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.252017 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.252153 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.252339 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.252568 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.252696 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.252965 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.253107 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.253281 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.253463 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.253590 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.253859 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.253987 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.254220 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.254348 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.254549 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.254677 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.254879 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.255017 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.255223 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.255411 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.255571 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.255847 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.255988 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.256191 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.256326 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.256509 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.256637 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.256912 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.257162 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.257300 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.257426 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.257551 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.257776 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.257904 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.258100 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.258236 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.258420 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.258557 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.258738 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.258939 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.259096 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.259360 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.259487 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.259706 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.259834 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.260026 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.260173 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.260342 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.260679 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.260827 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.260953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.261094 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.261821 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.261966 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.262174 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.262303 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.262502 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.262825 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.262953 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.263146 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.263274 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.263468 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.263638 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.263990 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.264118 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.264384 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.264518 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.264721 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.264849 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.265051 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.265180 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.265382 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.265544 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.265704 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.265925 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.266054 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.266343 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.266470 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.266656 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.266818 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.266978 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.267245 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.267384 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.267605 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.267876 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.268005 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.268184 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.268310 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.268432 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.268562 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.268800 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.268922 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.269122 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.269288 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.269436 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.269682 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.270024 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.270170 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.270379 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.270505 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.270714 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.270943 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.271071 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.271257 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.271386 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.271690 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.271818 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.272006 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.272248 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.272390 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.272633 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.272759 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.272943 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.273069 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.273263 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.273546 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.273674 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.273889 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.274014 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.274200 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.274343 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.274517 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.274746 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.274874 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.275124 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.275249 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.275439 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.275589 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.275771 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.276000 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.276128 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.276399 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.276612 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.276739 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.276860 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.277561 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.277816 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.278039 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.278182 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.278306 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.278461 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.278646 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.278773 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.279043 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.279173 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.279371 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.279498 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.279705 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.279914 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.280061 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.280564 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.280694 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.280879 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.281119 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.281248 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.281442 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.281571 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.281843 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.281971 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.282178 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.282369 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.282507 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.282757 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.282885 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.283092 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.283225 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.283409 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.283610 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.283764 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.284011 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.284139 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.284382 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.284522 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.284742 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.284871 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.285063 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.285191 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.285530 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.285740 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.285944 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.286080 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.286288 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.286414 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.286632 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.286774 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.286969 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.287097 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.287281 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.287496 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.287681 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.287917 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.288066 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.288297 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.288425 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.288553 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.288762 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.288891 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.289140 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.289268 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.289453 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.289592 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.289762 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.289980 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.290108 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.290378 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.290512 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.290691 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.290827 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.291005 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.291247 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.291391 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.291648 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.291833 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.291960 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.292086 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.292263 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.292455 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.292619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.292901 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.293031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.293270 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.293404 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.293596 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.293734 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.293916 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.294112 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.294256 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.294522 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.294650 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.294847 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.294975 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.295164 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.295370 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.295499 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.295800 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.295942 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.296119 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.296245 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.296455 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.296623 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.296775 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.297086 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.297212 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.297497 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.297814 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.297941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.298141 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.298389 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.298526 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.298706 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.298835 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.299083 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.299220 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.299410 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.299604 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.299766 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.299953 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.300081 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.300370 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.300563 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.300742 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.300881 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.301023 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.301159 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.301381 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.301718 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.301882 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.302010 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.302133 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.302266 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.302391 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.302627 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.302756 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.302940 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.303067 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.303257 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.303464 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.303627 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.303894 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.304022 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.304204 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.304351 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.304515 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.304677 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.304831 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.305056 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.305192 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.305487 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.305630 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.305758 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.305882 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.306046 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.306266 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.306395 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.306654 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.306781 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.306964 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.307119 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.307258 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.307511 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.307701 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.307890 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.308017 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.308236 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.308506 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.308653 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.308821 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.308956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.309145 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.309280 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.309453 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.309625 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.309755 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.310025 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.310155 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.310376 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.310502 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.310714 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.310841 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.311035 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.311186 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.311365 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.311617 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.311759 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.312037 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.312327 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.312455 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.312667 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.312793 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.312994 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.313133 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.313322 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.313515 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.313643 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.313905 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.314033 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.314261 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.314394 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.314577 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.314706 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.314893 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.315117 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.315246 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.315506 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.315679 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.315846 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.315973 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.316178 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.316332 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.316509 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.316736 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.316864 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.317133 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.317255 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.317451 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.317608 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.317799 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.318043 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.318172 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.318401 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.318528 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.318816 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.318947 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.319078 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.319267 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.319397 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.319660 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.319798 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.319977 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.320172 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.320304 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.320577 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.320715 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.320902 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.321029 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.321218 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.321352 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.321538 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.321764 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.321885 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.322183 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.322309 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.322514 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.322650 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.322829 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.322987 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.323160 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.323389 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.323516 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.324324 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.324460 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.324677 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.324803 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.325028 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.325156 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.325362 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.325494 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.325683 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.325854 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.326003 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.326252 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.326382 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.326548 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 12:10:24.326676 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.327038 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.327454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.327845 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.328206 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.328838 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.329192 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.329567 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.330017 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.330399 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.330762 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.331128 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.331493 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.331896 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.332296 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.332650 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.333003 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.333349 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.333712 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.334181 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.334726 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.336407 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.338314 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.340988 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.342650 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.344629 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.345320 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.345687 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.346037 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.346363 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.346720 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.350321 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.350321 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.350321 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.350321 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.350321 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.350321 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.350321 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.350321 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.350927 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.350927 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.351071 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.351303 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.351655 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.351953 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.352260 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.352578 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.352887 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.353196 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.353505 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.353816 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.354164 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.354586 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.354935 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.355825 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.356147 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.356503 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.356820 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.357130 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.357461 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.357762 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.358068 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.358396 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.358710 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.359014 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.359634 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.359634 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.359990 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.360546 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.361135 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.361470 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.361791 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.362136 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.362469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.362780 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.363094 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.363402 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.363836 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.364831 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.365214 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.365636 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.365991 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.366307 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.366622 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.366984 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.367295 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.367631 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.371815 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.371815 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.371815 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.371815 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.371815 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.371815 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.371815 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.371815 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.372684 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.372684 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.372684 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.372684 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.372684 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.373176 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.373176 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.373391 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.373681 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.374060 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.374775 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.376003 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.376332 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.376661 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.376987 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.377302 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.377634 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.377956 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.378268 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.378592 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.379019 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.379278 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.379647 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.380094 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.380427 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.380744 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.381051 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.381360 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.381671 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.382603 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.383518 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.384555 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.384872 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.385191 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.385501 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.385816 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.386122 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.386450 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.386761 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.387065 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.387371 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.387707 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.388009 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.388313 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.388621 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.388970 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.389276 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.389583 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.389884 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.390303 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.390609 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.390953 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.391293 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.391645 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.392018 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.392334 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.392658 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.392968 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.393290 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.393611 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.393934 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.394243 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.394575 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.394888 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.395195 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.395508 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.395832 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.396145 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.396531 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.396924 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.397250 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.397564 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.397891 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.398206 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.398528 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.398845 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.399158 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.399582 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.399872 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.400184 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.400500 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.400811 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.401121 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.401454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.401765 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.402093 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.402410 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.402728 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.403059 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.403423 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.403760 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.404562 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.404562 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.404799 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.405099 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.405704 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.406344 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.406661 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.406975 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.407283 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:24.407552 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 12:10:24.518393 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO dbcounter [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Registered counter for database nova_api Sep 05 12:10:24.540507 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_db.sqlalchemy.engines [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:10:24.547701 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG dbcounter [-] [105548] Writer thread running {{(pid=105548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:10:24.565145 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO dbcounter [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] Registered counter for database nova_api Sep 05 12:10:24.586984 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG oslo_db.sqlalchemy.engines [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:10:24.594402 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG dbcounter [-] [105549] Writer thread running {{(pid=105549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:10:24.607593 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.context [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9266b3e-0d18-400e-a40f-fa6d19190a0e(cell1) {{(pid=105548) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 12:10:24.611767 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:10:24.612259 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:10:24.613872 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:10:24.614650 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:10:24.615105 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:10:24.617166 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:10:24.619198 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO dbcounter [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Registered counter for database nova_cell0 Sep 05 12:10:24.623452 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO dbcounter [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Registered counter for database nova_cell1 Sep 05 12:10:24.631815 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_db.sqlalchemy.engines [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:10:24.633818 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_db.sqlalchemy.engines [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:10:24.639434 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG dbcounter [-] [105548] Writer thread running {{(pid=105548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:10:24.644714 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG dbcounter [-] [105548] Writer thread running {{(pid=105548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:10:24.653157 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.context [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9266b3e-0d18-400e-a40f-fa6d19190a0e(cell1) {{(pid=105549) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 12:10:24.657413 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG oslo_concurrency.lockutils [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:10:24.657816 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG oslo_concurrency.lockutils [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:10:24.659383 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG oslo_concurrency.lockutils [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:10:24.660126 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG oslo_concurrency.lockutils [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:10:24.660565 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG oslo_concurrency.lockutils [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:10:24.662529 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG oslo_concurrency.lockutils [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:10:24.664537 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO dbcounter [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] Registered counter for database nova_cell0 Sep 05 12:10:24.669219 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO dbcounter [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] Registered counter for database nova_cell1 Sep 05 12:10:24.676298 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG oslo_db.sqlalchemy.engines [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:10:24.681113 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG dbcounter [-] [105549] Writer thread running {{(pid=105549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:10:24.682493 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG oslo_db.sqlalchemy.engines [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:10:24.790264 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO dbcounter [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Registered counter for database nova_cell0 Sep 05 12:10:24.800124 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_db.sqlalchemy.engines [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:10:24.805168 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG dbcounter [-] [105548] Writer thread running {{(pid=105548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:10:24.823163 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG dbcounter [-] [105549] Writer thread running {{(pid=105549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:10:24.833351 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO dbcounter [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] Registered counter for database nova_cell0 Sep 05 12:10:24.843192 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG oslo_db.sqlalchemy.engines [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:10:24.851916 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG dbcounter [-] [105549] Writer thread running {{(pid=105549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:10:25.151338 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: WARNING keystonemiddleware.auth_token [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:10:25.159577 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: WARNING keystonemiddleware.auth_token [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:10:25.178305 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: WARNING keystonemiddleware.auth_token [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:10:25.185874 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: WARNING keystonemiddleware.auth_token [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:10:25.502996 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: WARNING keystonemiddleware.auth_token [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:10:25.508875 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: WARNING keystonemiddleware.auth_token [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:10:25.514779 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5617a5d0a9c0 pid: 105548 (default app) Sep 05 12:10:25.516902 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:10:25.518089 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001756 Sep 05 12:10:25.518507 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Mon Sep 5 12:10:25 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:10:25.529745 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: WARNING keystonemiddleware.auth_token [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:10:25.536096 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: WARNING keystonemiddleware.auth_token [None req-0916158c-fcd2-4225-be46-85e0d33d5e63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:10:25.541486 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5617a5d0a9c0 pid: 105549 (default app) Sep 05 12:11:45.373931 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:11:45.374489 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 05 12:11:45.380462 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Mon Sep 5 12:11:45 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:11:45.387788 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG dbcounter [-] [105549] Writing DB stats nova_api:SELECT=3 {{(pid=105549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:45.389322 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG dbcounter [-] [105549] Writing DB stats nova_cell0:SELECT=3 {{(pid=105549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:45.390145 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG dbcounter [-] [105549] Writing DB stats nova_cell1:SELECT=3 {{(pid=105549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:45.391184 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG dbcounter [-] [105549] Writing DB stats nova_cell0:SELECT=3 {{(pid=105549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:46.290295 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-11b1fd41-9180-438a-9074-8a78276e2a13 admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:11:46.322245 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-11b1fd41-9180-438a-9074-8a78276e2a13 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.939564 Sep 05 12:11:46.323133 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Sep 5 12:11:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:48.742212 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:11:48.742212 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-0ef5fe51-7edc-48fe-bb7c-e770e70f2b7a None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 05 12:11:48.742212 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Mon Sep 5 12:11:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:11:49.214156 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-b686f9c9-0284-40e0-9328-9f7dc55742cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "rxtx_factor": 1.0}} {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:11:49.265296 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-b686f9c9-0284-40e0-9328-9f7dc55742cf admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.515682 Sep 05 12:11:49.267735 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Sep 5 12:11:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:11:49.502671 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-06384e1d-490d-4754-a246-05ad27e03a5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:11:49.515113 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG dbcounter [-] [105548] Writing DB stats nova_api:SELECT=3 {{(pid=105548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:49.515113 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG dbcounter [-] [105548] Writing DB stats nova_cell0:SELECT=3 {{(pid=105548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:49.515113 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG dbcounter [-] [105548] Writing DB stats nova_cell1:SELECT=3 {{(pid=105548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:49.515113 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG dbcounter [-] [105548] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:49.583784 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-06384e1d-490d-4754-a246-05ad27e03a5d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.309263 Sep 05 12:11:49.584296 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Sep 5 12:11:49 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:11:51.986241 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-b686f9c9-0284-40e0-9328-9f7dc55742cf admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:11:51.987193 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-b686f9c9-0284-40e0-9328-9f7dc55742cf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 05 12:11:51.987623 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Mon Sep 5 12:11:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:11:52.692792 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-c2b470ac-ed45-49b9-93fe-20fe8fe656a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1", "disk": 5, "name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:11:52.733844 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-c2b470ac-ed45-49b9-93fe-20fe8fe656a8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.739779 Sep 05 12:11:52.734516 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Sep 5 12:11:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:11:52.746722 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-f123c8f4-4f93-426e-ac9e-7da24f8cebaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:11:52.807552 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-f123c8f4-4f93-426e-ac9e-7da24f8cebaf admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064118 Sep 05 12:11:52.808641 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Sep 5 12:11:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:11:55.256688 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-c2b470ac-ed45-49b9-93fe-20fe8fe656a8 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:11:55.257655 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-c2b470ac-ed45-49b9-93fe-20fe8fe656a8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 05 12:11:55.258096 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Mon Sep 5 12:11:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:11:55.706246 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-5e418c4d-bf11-4e72-98fe-9411f5025403 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "id": "d2", "name": "ds1G", "disk": 10}} {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:11:55.726612 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-5e418c4d-bf11-4e72-98fe-9411f5025403 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462137 Sep 05 12:11:55.727160 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Sep 5 12:11:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:11:55.739756 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-fb9aeb10-9650-4daa-ba9c-286af57afb4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:11:55.766609 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-fb9aeb10-9650-4daa-ba9c-286af57afb4c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029836 Sep 05 12:11:55.767472 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Sep 5 12:11:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:58.216837 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-5e418c4d-bf11-4e72-98fe-9411f5025403 admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:11:58.217801 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-5e418c4d-bf11-4e72-98fe-9411f5025403 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 05 12:11:58.218379 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Mon Sep 5 12:11:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:11:58.725075 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-e4426d8f-e4a3-4b59-9af8-60edbdd5c825 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:11:58.745231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-e4426d8f-e4a3-4b59-9af8-60edbdd5c825 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.520061 Sep 05 12:11:58.745781 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Sep 5 12:11:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:11:58.757804 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-6a5a514d-4c50-46d2-8055-8feba193f68c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:11:58.784825 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-6a5a514d-4c50-46d2-8055-8feba193f68c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030630 Sep 05 12:11:58.785877 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Sep 5 12:11:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:12:01.426981 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-e4426d8f-e4a3-4b59-9af8-60edbdd5c825 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:01.428083 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-e4426d8f-e4a3-4b59-9af8-60edbdd5c825 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 05 12:12:01.428491 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Mon Sep 5 12:12:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:12:01.942383 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-310401ec-23c4-4aa9-a8f3-5556492a71f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "id": "d4", "swap": 0, "vcpus": 4, "disk": 20}} {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:01.971143 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-310401ec-23c4-4aa9-a8f3-5556492a71f5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.535920 Sep 05 12:12:01.972439 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Sep 5 12:12:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:12:01.990363 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-4807f459-86f4-4a7e-b907-133f7235c488 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:02.028178 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-4807f459-86f4-4a7e-b907-133f7235c488 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043683 Sep 05 12:12:02.029009 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Sep 5 12:12:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:12:04.689451 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-310401ec-23c4-4aa9-a8f3-5556492a71f5 admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:04.690532 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-310401ec-23c4-4aa9-a8f3-5556492a71f5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 Sep 05 12:12:04.690961 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Mon Sep 5 12:12:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:12:05.219748 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-c47dd455-4ecc-4571-8bf6-33ef3b108592 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:05.245320 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-c47dd455-4ecc-4571-8bf6-33ef3b108592 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.547850 Sep 05 12:12:05.245924 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Sep 5 12:12:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:12:07.671855 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-310401ec-23c4-4aa9-a8f3-5556492a71f5 admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:07.672787 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-310401ec-23c4-4aa9-a8f3-5556492a71f5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 05 12:12:07.673195 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Mon Sep 5 12:12:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:12:08.132534 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-0c0a971b-e956-41ed-896c-7b5cbec790a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "id": "1"}} {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:08.153078 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-0c0a971b-e956-41ed-896c-7b5cbec790a6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.472391 Sep 05 12:12:08.154027 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Sep 5 12:12:07 2022] POST /compute/v2.1/flavors => generated 402 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:12:08.167225 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-8023244e-fac8-4c1d-9bc4-98c86c0fb42f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:08.196252 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-8023244e-fac8-4c1d-9bc4-98c86c0fb42f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032859 Sep 05 12:12:08.196833 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Sep 5 12:12:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:12:10.587016 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-0c0a971b-e956-41ed-896c-7b5cbec790a6 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:10.588003 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-0c0a971b-e956-41ed-896c-7b5cbec790a6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 05 12:12:10.588410 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Mon Sep 5 12:12:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:12:11.009749 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-f99be48d-264b-45e8-aad1-5558800363c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "disk": 20, "id": "2", "swap": 0, "name": "m1.small"}} {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:11.029914 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-f99be48d-264b-45e8-aad1-5558800363c4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.434420 Sep 05 12:12:11.030470 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Sep 5 12:12:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:12:11.042943 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-2a4db93a-641d-42f5-9df6-12a49527dd7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:11.068217 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-2a4db93a-641d-42f5-9df6-12a49527dd7b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029095 Sep 05 12:12:11.068783 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Sep 5 12:12:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:12:13.464064 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-f99be48d-264b-45e8-aad1-5558800363c4 admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:13.465115 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-f99be48d-264b-45e8-aad1-5558800363c4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002000 Sep 05 12:12:13.465752 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Mon Sep 5 12:12:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:12:13.903925 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-151df850-793a-4d26-a5e2-2a26ba62feb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "ram": 4096, "swap": 0, "vcpus": 2, "disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:13.925267 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-151df850-793a-4d26-a5e2-2a26ba62feb9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.452600 Sep 05 12:12:13.926134 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Sep 5 12:12:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:12:13.939608 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-29d6d85f-8ec2-4b43-b793-e3c7a5ccb81a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:13.994892 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-29d6d85f-8ec2-4b43-b793-e3c7a5ccb81a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059400 Sep 05 12:12:13.996218 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Sep 5 12:12:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:12:16.406968 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-151df850-793a-4d26-a5e2-2a26ba62feb9 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:16.407946 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-151df850-793a-4d26-a5e2-2a26ba62feb9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Sep 05 12:12:16.413409 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Mon Sep 5 12:12:16 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:12:16.867783 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-fbac2bbc-04a5-4336-b507-218810b3cdb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192}} {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:16.873501 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG dbcounter [-] [105549] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:16.891617 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-fbac2bbc-04a5-4336-b507-218810b3cdb3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.476890 Sep 05 12:12:16.892528 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Sep 5 12:12:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:12:16.904886 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-c4f05682-7a03-4ab2-b703-4ed7ea6dfc1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:16.932416 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-c4f05682-7a03-4ab2-b703-4ed7ea6dfc1c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031695 Sep 05 12:12:16.932998 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Sep 5 12:12:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:12:19.372517 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-fbac2bbc-04a5-4336-b507-218810b3cdb3 admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:19.373043 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-fbac2bbc-04a5-4336-b507-218810b3cdb3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 05 12:12:19.373460 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Mon Sep 5 12:12:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:12:19.870049 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-b7a72322-59e7-4645-900b-c1a2222f231b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384}} {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:19.878613 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG dbcounter [-] [105548] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:19.895629 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-b7a72322-59e7-4645-900b-c1a2222f231b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.513547 Sep 05 12:12:19.896276 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Sep 5 12:12:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 12:12:19.909471 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-a40aff3c-080f-4090-b497-eb5ae9cf6b10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:19.939631 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-a40aff3c-080f-4090-b497-eb5ae9cf6b10 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034318 Sep 05 12:12:19.951549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Sep 5 12:12:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:12:37.956253 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-b7a72322-59e7-4645-900b-c1a2222f231b admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:37.957269 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-b7a72322-59e7-4645-900b-c1a2222f231b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 05 12:12:37.957671 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Mon Sep 5 12:12:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:12:37.968883 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG dbcounter [-] [105549] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:38.364017 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-2e34b439-3a67-4e4d-9d1b-06d9c9c83ef5 admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:38.382859 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-2e34b439-3a67-4e4d-9d1b-06d9c9c83ef5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.418296 Sep 05 12:12:38.383392 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Sep 5 12:12:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:12:39.450668 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-b7a72322-59e7-4645-900b-c1a2222f231b admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:39.451742 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-b7a72322-59e7-4645-900b-c1a2222f231b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 05 12:12:39.452144 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Sep 5 12:12:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:12:39.979093 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-09d5559c-e96e-4081-b4ab-2052c5229306 admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:39.984721 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.wsgi [None req-09d5559c-e96e-4081-b4ab-2052c5229306 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-09d5559c-e96e-4081-b4ab-2052c5229306 admin admin] Request method failure captured: Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Accept: application/json Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Accept-Encoding: gzip, deflate Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Connection: keep-alive Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Content-Length: 0 Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Host: 10.222.0.16 Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Openstack-Api-Version: compute 2.92 Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Openstack-System-Scope: None Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: User-Agent: python-novaclient Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Auth-Token: gAAAAABjFee3lDdjk5TpKB3CR9G_Hn4Maz-JETy-8mJHSyY9nJ3wEkjOACMwSYpkIyqudUJo8nKsaXcxe81i3_Ln6plsJZsNemo6K77hViy4bBT48qfK5ifn0q4qKLouD5FDgMrJ7YMHTzcuhlrTC_0Z4Ld541hUXRMWkuYYJG8jRDYppUnTumI Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Domain-Id: None Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Domain-Name: None Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Identity-Status: Confirmed Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Is-Admin-Project: True Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Project-Domain-Id: default Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Project-Domain-Name: Default Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Project-Id: 898d4110c367417eb23c75ef5e13bda3 Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Project-Name: admin Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Role: reader,admin,member Sep 05 12:12:39.987981 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Roles: reader,admin,member Sep 05 12:12:39.989779 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_898d4110c367417eb23c75ef5e13bda3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/898d4110c367417eb23c75ef5e13bda3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/898d4110c367417eb23c75ef5e13bda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/898d4110c367417eb23c75ef5e13bda3"}]}] Sep 05 12:12:39.989779 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Tenant: admin Sep 05 12:12:39.989779 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Tenant-Id: 898d4110c367417eb23c75ef5e13bda3 Sep 05 12:12:39.989779 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Tenant-Name: admin Sep 05 12:12:39.989779 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User: admin Sep 05 12:12:39.989779 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User-Domain-Id: default Sep 05 12:12:39.989779 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User-Domain-Name: Default Sep 05 12:12:39.989779 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User-Id: 78575c7ceaa64d1b86e8eef0293f1e3c Sep 05 12:12:39.989779 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User-Name: admin Sep 05 12:12:39.989779 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: method: > Sep 05 12:12:39.989779 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: exception: Flavor 42 could not be found. Sep 05 12:12:39.989779 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: action_args: {'id': '42'} Sep 05 12:12:39.989779 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:12:39.989779 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:12:39.990852 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:39.992469 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-09d5559c-e96e-4081-b4ab-2052c5229306 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:12:39.994444 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-09d5559c-e96e-4081-b4ab-2052c5229306 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.399591 Sep 05 12:12:39.994444 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Sep 5 12:12:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 12:12:40.001094 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-02e10b63-05b7-45e3-a4bb-042b4b68eaf0 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:40.025164 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-02e10b63-05b7-45e3-a4bb-042b4b68eaf0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028772 Sep 05 12:12:40.025732 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Sep 5 12:12:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:12:40.035851 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-b1d348fb-338a-4495-a269-75e529e8484c admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:40.059122 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-b1d348fb-338a-4495-a269-75e529e8484c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026809 Sep 05 12:12:40.059699 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Sep 5 12:12:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:12:40.069161 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-35913438-765a-46b2-b2e9-7bfd571f5090 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:40.075774 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.wsgi [None req-35913438-765a-46b2-b2e9-7bfd571f5090 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-35913438-765a-46b2-b2e9-7bfd571f5090 admin admin] Request method failure captured: Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Accept: application/json Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Accept-Encoding: gzip, deflate Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Connection: keep-alive Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Content-Length: 0 Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Host: 10.222.0.16 Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Openstack-Api-Version: compute 2.92 Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Openstack-System-Scope: None Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: User-Agent: python-novaclient Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Auth-Token: gAAAAABjFee3lDdjk5TpKB3CR9G_Hn4Maz-JETy-8mJHSyY9nJ3wEkjOACMwSYpkIyqudUJo8nKsaXcxe81i3_Ln6plsJZsNemo6K77hViy4bBT48qfK5ifn0q4qKLouD5FDgMrJ7YMHTzcuhlrTC_0Z4Ld541hUXRMWkuYYJG8jRDYppUnTumI Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Domain-Id: None Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Domain-Name: None Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Identity-Status: Confirmed Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Is-Admin-Project: True Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Project-Domain-Id: default Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Project-Domain-Name: Default Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Project-Id: 898d4110c367417eb23c75ef5e13bda3 Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Project-Name: admin Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Role: reader,admin,member Sep 05 12:12:40.079031 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Roles: reader,admin,member Sep 05 12:12:40.080619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_898d4110c367417eb23c75ef5e13bda3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/898d4110c367417eb23c75ef5e13bda3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/898d4110c367417eb23c75ef5e13bda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/898d4110c367417eb23c75ef5e13bda3"}]}] Sep 05 12:12:40.080619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Tenant: admin Sep 05 12:12:40.080619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Tenant-Id: 898d4110c367417eb23c75ef5e13bda3 Sep 05 12:12:40.080619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Tenant-Name: admin Sep 05 12:12:40.080619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User: admin Sep 05 12:12:40.080619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User-Domain-Id: default Sep 05 12:12:40.080619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User-Domain-Name: Default Sep 05 12:12:40.080619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User-Id: 78575c7ceaa64d1b86e8eef0293f1e3c Sep 05 12:12:40.080619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User-Name: admin Sep 05 12:12:40.080619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: method: > Sep 05 12:12:40.080619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: exception: Flavor 42 could not be found. Sep 05 12:12:40.080619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: action_args: {'id': '42'} Sep 05 12:12:40.080619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:12:40.080619 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:12:40.081680 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:40.083132 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-35913438-765a-46b2-b2e9-7bfd571f5090 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:12:40.084465 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-35913438-765a-46b2-b2e9-7bfd571f5090 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014817 Sep 05 12:12:40.084465 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Sep 5 12:12:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 05 12:12:41.057012 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-b1d348fb-338a-4495-a269-75e529e8484c admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:41.058031 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-b1d348fb-338a-4495-a269-75e529e8484c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 05 12:12:41.058426 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Sep 5 12:12:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:12:41.606084 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-d352200a-2783-4731-a796-0d6c366eab76 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:41.611432 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.wsgi [None req-d352200a-2783-4731-a796-0d6c366eab76 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-d352200a-2783-4731-a796-0d6c366eab76 admin admin] Request method failure captured: Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Accept: application/json Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Accept-Encoding: gzip, deflate Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Connection: keep-alive Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Content-Length: 0 Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Host: 10.222.0.16 Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Openstack-Api-Version: compute 2.92 Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Openstack-System-Scope: None Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: User-Agent: python-novaclient Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Auth-Token: gAAAAABjFee4QLTyziSAdvMPSSKtAhCzOCm11AlbaHGsyUPKHbmGWuGUICrQT11gtALx5NsEkGX-wlFzNnWf3afttp-EUyA2ma4KmDhorn-Yv8F9-mBUOFRYlnyiY1oHIvfaVMgyJB7_zB7J-sOLbmsuD2lQTnPaVYmWDLX-ussGJ1gGdzviIZ8 Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Domain-Id: None Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Domain-Name: None Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Identity-Status: Confirmed Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Is-Admin-Project: True Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Project-Domain-Id: default Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Project-Domain-Name: Default Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Project-Id: 898d4110c367417eb23c75ef5e13bda3 Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Project-Name: admin Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Role: reader,admin,member Sep 05 12:12:41.612953 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Roles: reader,admin,member Sep 05 12:12:41.614423 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_898d4110c367417eb23c75ef5e13bda3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/898d4110c367417eb23c75ef5e13bda3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/898d4110c367417eb23c75ef5e13bda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/898d4110c367417eb23c75ef5e13bda3"}]}] Sep 05 12:12:41.614423 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Tenant: admin Sep 05 12:12:41.614423 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Tenant-Id: 898d4110c367417eb23c75ef5e13bda3 Sep 05 12:12:41.614423 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Tenant-Name: admin Sep 05 12:12:41.614423 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User: admin Sep 05 12:12:41.614423 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User-Domain-Id: default Sep 05 12:12:41.614423 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User-Domain-Name: Default Sep 05 12:12:41.614423 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User-Id: 78575c7ceaa64d1b86e8eef0293f1e3c Sep 05 12:12:41.614423 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User-Name: admin Sep 05 12:12:41.614423 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: method: > Sep 05 12:12:41.614423 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: exception: Flavor 84 could not be found. Sep 05 12:12:41.614423 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: action_args: {'id': '84'} Sep 05 12:12:41.614423 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:12:41.614423 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:12:41.615231 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:41.616555 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-d352200a-2783-4731-a796-0d6c366eab76 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:12:41.617612 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-d352200a-2783-4731-a796-0d6c366eab76 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.417885 Sep 05 12:12:41.617612 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Sep 5 12:12:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 12:12:41.624642 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-e438a0a4-859d-4651-9b37-816380043d12 admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:41.639552 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-e438a0a4-859d-4651-9b37-816380043d12 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018502 Sep 05 12:12:41.640095 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Sep 5 12:12:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:12:41.649714 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-64407641-8a79-4eba-ba02-3f776ad50829 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:41.665748 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-64407641-8a79-4eba-ba02-3f776ad50829 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018953 Sep 05 12:12:41.666350 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Sep 5 12:12:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:12:41.676394 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-722cbd59-a645-4fbb-8e86-8a748fbf271a admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:41.682383 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.wsgi [None req-722cbd59-a645-4fbb-8e86-8a748fbf271a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-722cbd59-a645-4fbb-8e86-8a748fbf271a admin admin] Request method failure captured: Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Accept: application/json Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Accept-Encoding: gzip, deflate Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Connection: keep-alive Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Content-Length: 0 Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Host: 10.222.0.16 Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Openstack-Api-Version: compute 2.92 Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Openstack-System-Scope: None Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: User-Agent: python-novaclient Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Auth-Token: gAAAAABjFee4QLTyziSAdvMPSSKtAhCzOCm11AlbaHGsyUPKHbmGWuGUICrQT11gtALx5NsEkGX-wlFzNnWf3afttp-EUyA2ma4KmDhorn-Yv8F9-mBUOFRYlnyiY1oHIvfaVMgyJB7_zB7J-sOLbmsuD2lQTnPaVYmWDLX-ussGJ1gGdzviIZ8 Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Domain-Id: None Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Domain-Name: None Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Identity-Status: Confirmed Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Is-Admin-Project: True Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Project-Domain-Id: default Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Project-Domain-Name: Default Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Project-Id: 898d4110c367417eb23c75ef5e13bda3 Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Project-Name: admin Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Role: reader,admin,member Sep 05 12:12:41.683941 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Roles: reader,admin,member Sep 05 12:12:41.685549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_898d4110c367417eb23c75ef5e13bda3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/898d4110c367417eb23c75ef5e13bda3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/898d4110c367417eb23c75ef5e13bda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/898d4110c367417eb23c75ef5e13bda3"}]}] Sep 05 12:12:41.685549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Tenant: admin Sep 05 12:12:41.685549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Tenant-Id: 898d4110c367417eb23c75ef5e13bda3 Sep 05 12:12:41.685549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Tenant-Name: admin Sep 05 12:12:41.685549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User: admin Sep 05 12:12:41.685549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User-Domain-Id: default Sep 05 12:12:41.685549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User-Domain-Name: Default Sep 05 12:12:41.685549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User-Id: 78575c7ceaa64d1b86e8eef0293f1e3c Sep 05 12:12:41.685549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User-Name: admin Sep 05 12:12:41.685549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: method: > Sep 05 12:12:41.685549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: exception: Flavor 84 could not be found. Sep 05 12:12:41.685549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: action_args: {'id': '84'} Sep 05 12:12:41.685549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:12:41.685549 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:12:41.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:41.687731 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-722cbd59-a645-4fbb-8e86-8a748fbf271a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:12:41.688818 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-722cbd59-a645-4fbb-8e86-8a748fbf271a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012879 Sep 05 12:12:41.688818 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Sep 5 12:12:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 12:12:42.652232 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-64407641-8a79-4eba-ba02-3f776ad50829 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:42.653210 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-64407641-8a79-4eba-ba02-3f776ad50829 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 05 12:12:42.653605 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Sep 5 12:12:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:12:43.171830 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-585039ec-7174-4766-bcf7-b00273bc0066 admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:43.177441 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.wsgi [None req-585039ec-7174-4766-bcf7-b00273bc0066 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-585039ec-7174-4766-bcf7-b00273bc0066 admin admin] Request method failure captured: Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Accept: application/json Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Accept-Encoding: gzip, deflate Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Connection: keep-alive Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Content-Length: 0 Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Host: 10.222.0.16 Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Openstack-Api-Version: compute 2.92 Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Openstack-System-Scope: None Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: User-Agent: python-novaclient Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Auth-Token: gAAAAABjFee65nYi5PJLN5tTeoZdBm3lbxpU68XZdOWFVCVNy-A6Mg37Z1Jn5HC8y0YTChKiikAR_itBzRnNfK2GYA_dtx7tCzuKVU1im3bRsB0Ns2rCEBGDPflt8bLMdw4IL6xiTDSaf0UB-Aiw3J9OTuIEGE0k9YLPHCfGyT9mUcESpAlZbz8 Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Domain-Id: None Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Domain-Name: None Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Identity-Status: Confirmed Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Is-Admin-Project: True Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Project-Domain-Id: default Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Project-Domain-Name: Default Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Project-Id: 898d4110c367417eb23c75ef5e13bda3 Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Project-Name: admin Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Role: reader,admin,member Sep 05 12:12:43.178922 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Roles: reader,admin,member Sep 05 12:12:43.180521 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_898d4110c367417eb23c75ef5e13bda3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/898d4110c367417eb23c75ef5e13bda3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/898d4110c367417eb23c75ef5e13bda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/898d4110c367417eb23c75ef5e13bda3"}]}] Sep 05 12:12:43.180521 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Tenant: admin Sep 05 12:12:43.180521 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Tenant-Id: 898d4110c367417eb23c75ef5e13bda3 Sep 05 12:12:43.180521 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-Tenant-Name: admin Sep 05 12:12:43.180521 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User: admin Sep 05 12:12:43.180521 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User-Domain-Id: default Sep 05 12:12:43.180521 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User-Domain-Name: Default Sep 05 12:12:43.180521 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User-Id: 78575c7ceaa64d1b86e8eef0293f1e3c Sep 05 12:12:43.180521 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: X-User-Name: admin Sep 05 12:12:43.180521 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: method: > Sep 05 12:12:43.180521 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: exception: Flavor 451 could not be found. Sep 05 12:12:43.180521 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: action_args: {'id': '451'} Sep 05 12:12:43.180521 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:12:43.180521 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:12:43.182090 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: ERROR nova.api.openstack.wsgi Sep 05 12:12:43.183434 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-585039ec-7174-4766-bcf7-b00273bc0066 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:12:43.184723 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-585039ec-7174-4766-bcf7-b00273bc0066 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388518 Sep 05 12:12:43.184723 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Sep 5 12:12:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 12:12:43.190665 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-fd54ef59-9fac-45e5-93f2-afb82651a924 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:43.206022 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-fd54ef59-9fac-45e5-93f2-afb82651a924 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018903 Sep 05 12:12:43.206550 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Sep 5 12:12:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:12:43.216205 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-4742b156-3578-44ab-b7f3-73094adc023c admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:43.231463 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-4742b156-3578-44ab-b7f3-73094adc023c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018807 Sep 05 12:12:43.232005 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Sep 5 12:12:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:12:43.241579 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-7ea2eefb-c9a8-4264-96ee-f49a91890027 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:43.247871 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.wsgi [None req-7ea2eefb-c9a8-4264-96ee-f49a91890027 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-7ea2eefb-c9a8-4264-96ee-f49a91890027 admin admin] Request method failure captured: Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Accept: application/json Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Accept-Encoding: gzip, deflate Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Connection: keep-alive Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Content-Length: 0 Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Host: 10.222.0.16 Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Openstack-Api-Version: compute 2.92 Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Openstack-System-Scope: None Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: User-Agent: python-novaclient Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Auth-Token: gAAAAABjFee65nYi5PJLN5tTeoZdBm3lbxpU68XZdOWFVCVNy-A6Mg37Z1Jn5HC8y0YTChKiikAR_itBzRnNfK2GYA_dtx7tCzuKVU1im3bRsB0Ns2rCEBGDPflt8bLMdw4IL6xiTDSaf0UB-Aiw3J9OTuIEGE0k9YLPHCfGyT9mUcESpAlZbz8 Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Domain-Id: None Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Domain-Name: None Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Identity-Status: Confirmed Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Is-Admin-Project: True Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Project-Domain-Id: default Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Project-Domain-Name: Default Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Project-Id: 898d4110c367417eb23c75ef5e13bda3 Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Project-Name: admin Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Role: reader,admin,member Sep 05 12:12:43.249389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Roles: reader,admin,member Sep 05 12:12:43.250956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_898d4110c367417eb23c75ef5e13bda3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/898d4110c367417eb23c75ef5e13bda3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/898d4110c367417eb23c75ef5e13bda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/898d4110c367417eb23c75ef5e13bda3"}]}] Sep 05 12:12:43.250956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Tenant: admin Sep 05 12:12:43.250956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Tenant-Id: 898d4110c367417eb23c75ef5e13bda3 Sep 05 12:12:43.250956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-Tenant-Name: admin Sep 05 12:12:43.250956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User: admin Sep 05 12:12:43.250956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User-Domain-Id: default Sep 05 12:12:43.250956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User-Domain-Name: Default Sep 05 12:12:43.250956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User-Id: 78575c7ceaa64d1b86e8eef0293f1e3c Sep 05 12:12:43.250956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: X-User-Name: admin Sep 05 12:12:43.250956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: method: > Sep 05 12:12:43.250956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: exception: Flavor 451 could not be found. Sep 05 12:12:43.250956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: action_args: {'id': '451'} Sep 05 12:12:43.250956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:12:43.250956 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:12:43.251854 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: ERROR nova.api.openstack.wsgi Sep 05 12:12:43.252952 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-7ea2eefb-c9a8-4264-96ee-f49a91890027 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:12:43.254059 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-7ea2eefb-c9a8-4264-96ee-f49a91890027 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012999 Sep 05 12:12:43.254059 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Sep 5 12:12:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 12:12:44.220642 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-4742b156-3578-44ab-b7f3-73094adc023c admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:44.221662 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-4742b156-3578-44ab-b7f3-73094adc023c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 05 12:12:44.222061 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Sep 5 12:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:12:44.765522 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-72da0b38-9d86-47ab-a541-91f42a82ca82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:44.785659 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-72da0b38-9d86-47ab-a541-91f42a82ca82 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.408878 Sep 05 12:12:44.786256 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Sep 5 12:12:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:12:45.759865 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-4742b156-3578-44ab-b7f3-73094adc023c admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:45.760884 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-4742b156-3578-44ab-b7f3-73094adc023c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002047 Sep 05 12:12:45.761282 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Sep 5 12:12:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:12:46.288532 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-fd38a000-bdc6-4d10-8eaf-4ffe73f9e267 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:46.308113 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-fd38a000-bdc6-4d10-8eaf-4ffe73f9e267 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.404851 Sep 05 12:12:46.308657 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Sep 5 12:12:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:12:47.297023 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-4742b156-3578-44ab-b7f3-73094adc023c admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:47.298131 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-4742b156-3578-44ab-b7f3-73094adc023c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Sep 05 12:12:47.298659 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Sep 5 12:12:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:12:47.827424 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-3300eeab-d3ed-47c1-9976-fed93c83036a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:47.848512 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-3300eeab-d3ed-47c1-9976-fed93c83036a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.410472 Sep 05 12:12:47.849142 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Sep 5 12:12:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:12:48.831358 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-4742b156-3578-44ab-b7f3-73094adc023c admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:48.832858 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-4742b156-3578-44ab-b7f3-73094adc023c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002012 Sep 05 12:12:48.833389 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Sep 5 12:12:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:12:49.363598 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-16ea2d65-c424-40c4-8320-6af2d427212a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:12:49.383197 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-16ea2d65-c424-40c4-8320-6af2d427212a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.409736 Sep 05 12:12:49.383840 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Sep 5 12:12:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:12:50.357583 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-4742b156-3578-44ab-b7f3-73094adc023c admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:50.358596 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-4742b156-3578-44ab-b7f3-73094adc023c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 05 12:12:50.358996 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Sep 5 12:12:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:12:50.903096 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-33dea0b3-08b3-4333-8a1f-8921c1b493d4 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:12:50.924153 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-33dea0b3-08b3-4333-8a1f-8921c1b493d4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.426730 Sep 05 12:12:50.924677 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Mon Sep 5 12:12:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:13:44.854339 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-4742b156-3578-44ab-b7f3-73094adc023c admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:13:44.855354 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-4742b156-3578-44ab-b7f3-73094adc023c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 05 12:13:44.855788 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Mon Sep 5 12:13:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:13:44.866214 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG dbcounter [-] [105548] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:45.247248 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-e66545c3-5ac9-4476-8c38-4e90d40737e6 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:13:45.268182 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-e66545c3-5ac9-4476-8c38-4e90d40737e6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406459 Sep 05 12:13:45.268728 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Sep 5 12:13:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:13:45.290184 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG dbcounter [-] [105549] Writing DB stats nova_api:SELECT=14 {{(pid=105549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:45.294241 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-da505244-5b3d-472e-88cc-180ce8e2376c admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:13:45.301999 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-da505244-5b3d-472e-88cc-180ce8e2376c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013207 Sep 05 12:13:45.302555 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Mon Sep 5 12:13:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:13:45.314717 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-4bc4d437-8c8a-4c6d-902e-da07c856933e admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:13:45.322759 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-4bc4d437-8c8a-4c6d-902e-da07c856933e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011711 Sep 05 12:13:45.323275 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Mon Sep 5 12:13:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:13:45.335267 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-50115e22-65a4-4162-ad87-e9d156089b8b admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:13:45.343064 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-50115e22-65a4-4162-ad87-e9d156089b8b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011917 Sep 05 12:13:45.343602 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Mon Sep 5 12:13:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:13:45.354771 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-802614b4-aa35-424d-85e6-dde120e700eb admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:13:45.362339 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-802614b4-aa35-424d-85e6-dde120e700eb admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011028 Sep 05 12:13:45.362853 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Mon Sep 5 12:13:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:16:41.283203 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-50115e22-65a4-4162-ad87-e9d156089b8b admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:16:41.284257 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-50115e22-65a4-4162-ad87-e9d156089b8b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 05 12:16:41.284655 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Sep 5 12:16:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:16:41.426371 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG dbcounter [-] [105548] Writing DB stats nova_api:SELECT=6 {{(pid=105548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:41.589135 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-7524b380-38f5-41e7-a583-29f59838471e admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:16:41.592591 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-7524b380-38f5-41e7-a583-29f59838471e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:16:41.593064 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-7524b380-38f5-41e7-a583-29f59838471e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:16:41.593620 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-7524b380-38f5-41e7-a583-29f59838471e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:16:41.594338 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-7524b380-38f5-41e7-a583-29f59838471e admin admin] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:16:41.594782 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-7524b380-38f5-41e7-a583-29f59838471e admin admin] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:16:41.595195 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-7524b380-38f5-41e7-a583-29f59838471e admin admin] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:16:41.628791 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-7524b380-38f5-41e7-a583-29f59838471e admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.203690 Sep 05 12:16:41.629778 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Sep 5 12:16:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:16:42.467311 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-50115e22-65a4-4162-ad87-e9d156089b8b admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:16:42.468395 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-50115e22-65a4-4162-ad87-e9d156089b8b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 05 12:16:42.468789 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Sep 5 12:16:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:16:42.662204 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-f637865c-d7d8-4f79-a7fa-dd64a67b554b admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:16:42.665906 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-f637865c-d7d8-4f79-a7fa-dd64a67b554b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:16:42.666389 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-f637865c-d7d8-4f79-a7fa-dd64a67b554b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:16:42.666825 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-f637865c-d7d8-4f79-a7fa-dd64a67b554b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:16:42.667576 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-f637865c-d7d8-4f79-a7fa-dd64a67b554b admin admin] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:16:42.668029 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-f637865c-d7d8-4f79-a7fa-dd64a67b554b admin admin] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:16:42.668451 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-f637865c-d7d8-4f79-a7fa-dd64a67b554b admin admin] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:16:42.688979 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-f637865c-d7d8-4f79-a7fa-dd64a67b554b admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.079425 Sep 05 12:16:42.689569 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Sep 5 12:16:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:16:54.083079 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-50115e22-65a4-4162-ad87-e9d156089b8b admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:16:54.084159 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-50115e22-65a4-4162-ad87-e9d156089b8b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Sep 05 12:16:54.084569 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Sep 5 12:16:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:16:54.233989 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG dbcounter [-] [105548] Writing DB stats nova_cell0:SELECT=4 {{(pid=105548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:54.234789 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG dbcounter [-] [105548] Writing DB stats nova_cell1:SELECT=4 {{(pid=105548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:54.235331 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG dbcounter [-] [105548] Writing DB stats nova_api:SELECT=8 {{(pid=105548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:54.296156 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-63b5776c-c42e-4e70-84dc-27dcab97d950 admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:16:54.299810 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-63b5776c-c42e-4e70-84dc-27dcab97d950 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:16:54.300295 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-63b5776c-c42e-4e70-84dc-27dcab97d950 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:16:54.300731 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-63b5776c-c42e-4e70-84dc-27dcab97d950 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:16:54.302070 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-63b5776c-c42e-4e70-84dc-27dcab97d950 admin admin] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:16:54.302519 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-63b5776c-c42e-4e70-84dc-27dcab97d950 admin admin] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:16:54.302945 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-63b5776c-c42e-4e70-84dc-27dcab97d950 admin admin] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:16:54.328703 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-63b5776c-c42e-4e70-84dc-27dcab97d950 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.099074 Sep 05 12:16:54.329569 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Sep 5 12:16:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:16:55.194475 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: DEBUG nova.api.openstack.wsgi [None req-50115e22-65a4-4162-ad87-e9d156089b8b admin admin] Calling method '>' {{(pid=105549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:16:55.195613 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: INFO nova.api.openstack.requestlog [None req-50115e22-65a4-4162-ad87-e9d156089b8b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 05 12:16:55.196025 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: [pid: 105549|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Sep 5 12:16:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:16:55.401604 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG nova.api.openstack.wsgi [None req-dc944340-a9b7-4b9b-861f-d4f36f451f9f admin admin] Calling method '>' {{(pid=105548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:16:55.405133 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-dc944340-a9b7-4b9b-861f-d4f36f451f9f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:16:55.405701 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-dc944340-a9b7-4b9b-861f-d4f36f451f9f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:16:55.406137 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-dc944340-a9b7-4b9b-861f-d4f36f451f9f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:16:55.406849 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-dc944340-a9b7-4b9b-861f-d4f36f451f9f admin admin] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:16:55.407290 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-dc944340-a9b7-4b9b-861f-d4f36f451f9f admin admin] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:16:55.407734 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: DEBUG oslo_concurrency.lockutils [None req-dc944340-a9b7-4b9b-861f-d4f36f451f9f admin admin] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:16:55.431848 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: INFO nova.api.openstack.requestlog [None req-dc944340-a9b7-4b9b-861f-d4f36f451f9f admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.094332 Sep 05 12:16:55.432446 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: [pid: 105548|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Sep 5 12:16:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:17:55.591499 dv-cinder-855189-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 05 12:17:55.592322 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: Mon Sep 5 12:17:55 2022 - graceful shutdown triggered... Sep 05 12:17:55.593007 dv-cinder-855189-1-iscsi devstack@n-api.service[105548]: Gracefully killing worker 1 (pid: 105548)... Sep 05 12:17:55.593551 dv-cinder-855189-1-iscsi devstack@n-api.service[105549]: Gracefully killing worker 2 (pid: 105549)... Sep 05 12:17:56.593265 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: worker 1 buried after 1 seconds Sep 05 12:17:56.593265 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: worker 2 buried after 1 seconds Sep 05 12:17:56.593265 dv-cinder-855189-1-iscsi devstack@n-api.service[105547]: goodbye to uWSGI. Sep 05 12:17:56.595142 dv-cinder-855189-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 05 12:17:56.595824 dv-cinder-855189-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 05 12:17:56.599749 dv-cinder-855189-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 05 12:17:56.610693 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 05 12:17:56.614084 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 5 12:17:56 2022] *** Sep 05 12:17:56.614278 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 05 12:17:56.614401 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 05 12:17:56.614499 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: nodename: dv-cinder-855189-1-iscsi Sep 05 12:17:56.614592 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: machine: x86_64 Sep 05 12:17:56.614700 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: clock source: unix Sep 05 12:17:56.614800 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: pcre jit disabled Sep 05 12:17:56.614893 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: detected number of CPU cores: 4 Sep 05 12:17:56.614985 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: current working directory: / Sep 05 12:17:56.615084 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: detected binary path: /usr/bin/uwsgi-core Sep 05 12:17:56.615185 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: your processes number limit is 47680 Sep 05 12:17:56.615281 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: your memory page size is 4096 bytes Sep 05 12:17:56.615381 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: detected max file descriptor number: 2048 Sep 05 12:17:56.615493 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: lock engine: pthread robust mutexes Sep 05 12:17:56.615812 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: thunder lock: enabled Sep 05 12:17:56.616205 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 05 12:17:56.616601 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 05 12:17:56.658706 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: Python main interpreter initialized at 0x55d0fd09b9c0 Sep 05 12:17:56.659500 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: python threads support enabled Sep 05 12:17:56.659659 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: your server socket listen backlog is limited to 100 connections Sep 05 12:17:56.659780 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: your mercy for graceful operations on workers is 90 seconds Sep 05 12:17:56.660243 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: mapped 403077 bytes (393 KB) for 2 cores Sep 05 12:17:56.660479 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: *** Operational MODE: preforking *** Sep 05 12:17:56.660996 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: *** uWSGI is running in multiple interpreter mode *** Sep 05 12:17:56.661148 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: spawned uWSGI master process (pid: 120517) Sep 05 12:17:56.661532 dv-cinder-855189-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 05 12:17:56.662259 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: spawned uWSGI worker 1 (pid: 120534, cores: 1) Sep 05 12:17:56.662757 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: spawned uWSGI worker 2 (pid: 120535, cores: 1) Sep 05 12:17:56.663036 dv-cinder-855189-1-iscsi devstack@n-api.service[120517]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 05 12:17:57.363367 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 12:17:57.390661 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 12:17:58.588456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:17:58.588456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: from cryptography.utils import int_from_bytes Sep 05 12:17:58.589509 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:17:58.589509 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: from cryptography.utils import int_from_bytes Sep 05 12:17:58.636926 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:17:58.636926 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: from cryptography.utils import int_from_bytes Sep 05 12:17:58.637848 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:17:58.637848 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: from cryptography.utils import int_from_bytes Sep 05 12:18:01.141790 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 12:18:01.142691 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 12:18:01.142691 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 12:18:01.142989 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 12:18:01.144552 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 12:18:01.144552 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.144552 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.145012 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.145164 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.145689 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.145689 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.146059 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.146425 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.146679 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.146939 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.147303 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.147788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855189-1-iscsi {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.148125 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.148438 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.148759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.149342 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.149659 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.149987 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.150763 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.150763 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.153006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.153006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.153006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.153006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.153006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.153713 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.153713 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.153994 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.154171 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.154538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.154884 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855189-1-iscsi {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.155210 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.155514 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.155859 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.156296 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.156586 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.156920 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.157223 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.157563 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.157875 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.158213 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.158562 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.159432 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.159786 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.160096 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.160403 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.160906 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.161698 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.161698 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.162174 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.162174 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.162590 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.162904 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.163130 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.163354 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.163751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.163983 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.164198 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.164541 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.164776 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.165475 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.165475 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.165826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.166141 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.166382 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.167719 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.167719 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.167719 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.167719 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.167719 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.168339 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.168339 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.168818 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.168967 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.169256 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.169739 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.170010 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.170394 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.170668 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.170916 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.171274 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.171505 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.171914 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.172153 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.172424 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.172672 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.172986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.173222 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.173508 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.173829 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.174134 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.174484 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.174795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.175098 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.175451 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.175748 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.176034 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.176343 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.176698 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.176947 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.177250 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.177789 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.178050 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.178288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.178608 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.178931 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.179244 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.179577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.179891 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.180282 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.180626 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.180941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.181253 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.181584 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.181902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.182298 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.182628 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.182942 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.183318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.183714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.184028 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.184397 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.184743 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.185066 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.185439 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.185787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.186087 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.186400 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.186700 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.188461 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.188461 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.188461 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.188461 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.188461 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.189668 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.189668 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.189668 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.189668 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.190740 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.190740 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.190740 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.194820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.194820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.194820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.194820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.194820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.194820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.194820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.194820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.196990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.196990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.196990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.196990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.196990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.196990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.196990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.196990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.199184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.199184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.199184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.199184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.199184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.199184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.199184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.199184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.201058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.201058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.201058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.201058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.201058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.201058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.201058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.201058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.203036 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.203036 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.203036 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.203036 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.203036 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.203036 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.203036 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.204924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.204924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.204924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.204924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.204924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.204924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.207400 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.207400 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.207400 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.207400 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.207400 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.207400 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.207400 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.209577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.209577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.209577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.209577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.209577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.209577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.209577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.211108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.211108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.211108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.211108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.211108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.212585 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.212585 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.212585 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.212585 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.212585 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.213675 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.213675 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.213675 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.214491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.214491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.214491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.215211 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.215211 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.215703 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.215703 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.216171 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.216419 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.216653 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.216940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.217271 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.217602 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.217924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.218232 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.218545 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.218855 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.219347 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.222330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.222330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.222330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.222330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.222330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.222330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.222330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.222330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.224277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.224277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.224277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.224277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.224277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.224277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.225601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.225601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.225601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.225601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.225601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.226744 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.226744 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.226744 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.227372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.227372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.228155 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.228155 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.228155 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.229971 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.229971 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.229971 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.229971 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.229971 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.229971 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.230778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.231407 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.232613 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.233369 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.234137 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.234928 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.235700 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.236296 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.236914 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.237609 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.238621 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.239171 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.239837 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.240422 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.241045 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.253870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.253870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.253870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.253870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.253870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.253870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.253870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.253870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.256061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.256061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.256061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.256061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.256061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.256061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.256061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.258578 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.258578 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.258578 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.259258 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.259866 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.260469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.261054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.261635 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.262215 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.262834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.263412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.264103 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.264760 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.265337 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.265929 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.267833 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.274932 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.275712 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.276313 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.277113 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.278090 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.278388 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.278736 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.279348 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.280029 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.280630 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.281243 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.281814 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.282390 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.283003 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.283659 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.284828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.285510 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.286282 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.286783 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.287372 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 12:18:01.288278 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 12:18:01.288514 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.288768 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 12:18:01.289017 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.289257 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 12:18:01.289257 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 12:18:01.290178 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.290340 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.290568 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.290780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.290780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.291189 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.291411 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.291411 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.291895 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.292053 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.292053 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.292457 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.292699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.292699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.293156 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.293384 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.293384 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.293384 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855189-1-iscsi {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.294099 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.294336 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.294336 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.294946 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.295211 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.295458 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.295721 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.295721 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.296383 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.296619 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.296619 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.296619 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.297696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.297943 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.297943 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.298401 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.298644 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.298644 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.299562 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.300506 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.300506 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.300982 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.301238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.301238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.301683 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.301960 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.301960 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.302401 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.302632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855189-1-iscsi {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.302632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.303093 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.303337 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.303337 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.303827 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.304093 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.304452 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.304701 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.304701 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.305334 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.305579 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.305579 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.305579 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.305579 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.306677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.306991 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.307238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.307502 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.307502 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.308332 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.308585 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.308829 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.309071 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.309071 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.309512 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.309749 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.309749 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.311276 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.311566 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.311566 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.312039 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.312311 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.312311 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.312782 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.313024 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.313024 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.313024 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.313697 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.313930 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.313930 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.314415 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.314666 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.314926 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.315210 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.315210 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.315922 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.316183 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.316183 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.318400 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.318688 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.318688 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.318688 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.319420 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.319782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.320073 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.320355 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.320355 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.321547 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.321935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.322490 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.322741 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.322741 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.323798 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.324050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.324050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.324502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.324750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.324750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.324750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.324750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.324750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.324750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.324750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.324750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.327196 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.327196 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.327196 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.327196 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.327196 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.327196 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.327196 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.327196 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.330381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.330381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.330381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.330381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.330381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.330381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.330381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.330381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.333509 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.333509 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.333509 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.333509 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.334450 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.334712 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.334712 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.334712 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.335416 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.335739 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.335739 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.336693 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.336955 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.336955 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.337522 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.337987 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.337987 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.338887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.339231 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.339231 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.340343 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.340593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.340593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.341066 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.341331 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.342267 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.343695 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.343695 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.343695 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.343695 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.344696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.344944 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.344944 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.345425 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.345684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.347810 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.348287 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.348287 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.348798 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.349331 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.349331 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.350951 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.351223 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.351223 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.351730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.352698 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.352698 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.353204 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.353474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.353474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.353973 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.354234 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.354234 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.354824 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.355078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.355078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.355578 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.355828 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:18:01.356104 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.356353 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.356353 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.356353 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.357079 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.357322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.357658 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.358109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.358109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.358800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.359042 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.359042 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.359873 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.360115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.360365 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.360639 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.360639 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.360639 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.361350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.361611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.362060 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.363008 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.363267 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.363599 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.363599 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.364085 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.364330 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.364578 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.364842 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.364842 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.365337 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.365583 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.365583 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.366160 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.366409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.366776 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.367031 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.367031 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.367505 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.374487 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.374903 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.375189 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.375446 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.375786 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.375786 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.376292 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.376556 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.376802 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.377071 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.377071 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.377595 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.378849 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.378849 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.379364 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.380558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.380843 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.381008 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.381008 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.381429 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.381648 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.381869 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.382079 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.382079 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.382501 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.382726 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.382969 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.384646 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.384646 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.385117 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.385346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.385575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.385859 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.385859 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.386301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.386528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.386528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.386943 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.387153 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.387360 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.387742 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.387742 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.388248 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.388459 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.388459 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.388881 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.389100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.389100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.389515 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.389713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.389713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.390112 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.390385 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.390385 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.390759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.390956 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.391172 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.391386 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.391386 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.391883 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.392172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.392172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.392580 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.392799 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.392799 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.396212 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.396451 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.396451 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.396880 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.397094 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.397094 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.397526 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.397740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.397740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.398622 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.398838 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.398838 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.399583 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.399828 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.399828 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.400229 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.400461 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.400461 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.400873 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.401092 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.401092 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.401589 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.401829 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.401829 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.402235 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.402450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.402450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.402847 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.403056 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.403271 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.403491 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.403491 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.404824 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.406018 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.406018 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.406618 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.406790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.406790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.407177 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.407383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.407383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.407703 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.407854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.407854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.408315 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.408536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.408536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.409576 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.409792 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.409792 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.409792 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.409792 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.410599 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.410815 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.410815 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.411517 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.411795 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.411795 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.412194 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.412396 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.412396 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.412820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.413047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.413252 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.413457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.413457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.413893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.414095 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.414315 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.414531 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.414531 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.414928 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.415166 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.416415 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.417050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.417050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.417455 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.417675 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.417885 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.418110 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.418110 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.418579 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.418784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.418784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.418784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.418784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.418784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.418784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.418784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.418784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.420497 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.420497 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.420497 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.420497 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.421290 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.421505 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.421505 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.421897 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.422103 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.422103 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.422506 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.422705 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.422705 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.422705 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.423259 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.423476 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.423476 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.423476 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.423476 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.424361 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.424598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.424598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.425010 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.425223 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.425476 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.425863 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.425863 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.427555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.427770 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.428048 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.428279 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.428570 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.428791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.429014 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.429292 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.429518 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.429746 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.429746 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.430150 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.430355 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.430561 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.430885 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.431095 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.431313 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.431313 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.431731 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.431937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.432166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.432383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.432383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.432780 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.432980 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.432980 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.433430 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.433636 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.433837 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.434040 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.434040 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.434469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.434702 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.434929 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.435150 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.437623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.437879 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.437879 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.438299 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.438590 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.438802 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.439008 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.439008 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.439418 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.439673 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.439900 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.440141 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.440141 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.440499 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.440714 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.440932 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.441151 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.441374 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.441581 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.441581 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.441988 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.441988 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.442666 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.442880 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.443093 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.443417 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.443680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.443884 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.444089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.444306 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.444516 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.444745 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.444950 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.445174 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.445381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.445601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.445819 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.445819 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.446214 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.446438 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.447914 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.448133 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.448133 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.448553 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.448824 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.449035 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.449267 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.449480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.449698 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.449698 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.450110 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.450336 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.450563 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.450790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.451016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.451243 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.451451 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.451784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.451784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.452182 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.452182 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.452634 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.452974 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.453187 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.453187 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.453618 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.453847 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.454083 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.454294 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.454513 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.454844 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.455053 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.455262 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.455484 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.456917 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.458321 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.458536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.458743 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.459019 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.459218 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.459422 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.459422 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.459885 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.459885 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.460294 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.460294 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.461490 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.461713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.461938 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.462141 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.462340 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.462568 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.462792 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.463172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.463172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.463579 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.463786 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.464021 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.464257 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.464490 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.464925 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.464925 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.465332 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.465548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.465771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.465988 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.466209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.466424 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.466424 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.466834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.467052 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.467300 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.467654 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.468980 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.469191 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.469406 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.469615 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.469833 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.470046 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.470251 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.470454 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.470680 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.470901 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.470901 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.471876 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.472085 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.472293 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.472518 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.472735 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.472952 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.473795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.474008 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.474227 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.474436 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.474664 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.475278 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.476456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.476714 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.476934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.477230 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.477469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.477701 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.477921 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.479232 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.479487 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.479772 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.479772 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.480178 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.480396 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.480613 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.480828 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.481026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.481232 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.481448 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.481649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.481649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.482055 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.482269 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.482495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.482718 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.482718 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.483108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.483284 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.483468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.483698 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.484059 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.484248 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.484248 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.484650 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.484866 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.485078 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.485452 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.485659 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.485921 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.486192 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.486399 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.486399 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.486801 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.487047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.487269 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.487479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.487707 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.487940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.488147 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.488349 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.489592 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.489760 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.489926 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.490090 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.490267 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.490422 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.490576 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.490736 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.490908 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.491070 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.491070 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.491361 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.491512 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.491695 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.492002 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.492165 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.492331 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.492475 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.492613 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.492756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.492923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.492923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.493213 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.493364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.493522 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.493687 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.493839 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.494030 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.494030 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.494327 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.494490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.494661 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.494843 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.494993 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.495140 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.495297 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.495491 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.495491 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.495879 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.496049 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.496211 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.496385 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.496385 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.496686 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.496847 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.497053 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.497233 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.497403 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.497649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.497805 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.497964 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.498117 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.498267 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.498438 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.498602 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.498784 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.498959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.499136 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.499351 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.499545 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.499696 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.499857 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.500004 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.500159 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.500326 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.500481 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.500631 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.500631 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.500932 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.501107 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.501325 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.501480 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.501631 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.501787 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.501787 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.502072 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.502212 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.502353 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.503054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.503222 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.503373 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.503577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.503749 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.503749 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.504016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.504167 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.504334 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.504508 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.504671 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.504823 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.504983 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.505132 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.505298 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.505467 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.505467 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.505750 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.505908 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.506053 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.506209 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.506375 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.506532 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.506532 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.506835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.506985 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.507148 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.507306 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.507485 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.507709 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.507709 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.507986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.508231 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.508231 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.508529 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.508688 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.508842 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.508988 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.509124 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.509258 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.509394 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.509533 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.509533 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.509791 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.509938 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.510070 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.510212 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.510357 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.510492 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.510657 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.510795 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.510795 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.511059 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.511198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.511348 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.511502 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.511502 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.511831 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.512316 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.512479 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.512643 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.512643 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.512913 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.513054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.513195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.513336 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.513494 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.513644 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.513644 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.513926 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.514083 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.514233 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.514520 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.514676 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.514826 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.514980 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.515128 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.515128 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.515128 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.515683 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.515683 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.515965 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.516118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.516303 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.516303 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.516592 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.516746 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.516896 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.516896 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.517199 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.517343 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.517497 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.517701 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.517854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.518007 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.518228 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.518228 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.519031 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.519184 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.519333 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.519497 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.519691 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.519843 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.519995 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.520157 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.520311 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.520476 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.520645 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.520804 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.520964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.521189 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.521377 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.521554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.521756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.521922 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.521922 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.521922 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.522368 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.522547 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.522714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.522910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.523072 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.523228 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.523228 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.523562 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.523714 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.523864 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.524016 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.524440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.524606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.524756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.524913 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.525061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.525205 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.525205 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.525494 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.525652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.525811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.525954 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.526108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.526252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.526420 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.526580 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.526746 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.526896 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.527045 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.527205 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.527357 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.527618 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.527803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.527958 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.528122 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.528283 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.528442 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.528602 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.528602 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.528901 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.529052 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.529231 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.529384 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.529544 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.529769 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.529921 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.530072 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.530246 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.530461 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.530618 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.530769 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.530921 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.531086 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.531243 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.531398 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.531398 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.531842 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.532068 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.532300 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.532572 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.532948 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.533195 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.533480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.533775 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.533775 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.534327 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.534560 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.534560 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.535024 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.535290 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.535638 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.535903 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.535903 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.536422 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.536677 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.536931 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.537215 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.537475 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.537741 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.538060 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.538297 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.538553 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.538794 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.539033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.539275 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.539507 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.539793 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.539793 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.540184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.540333 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.540547 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.540791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.540791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.541262 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.541501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.541733 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.541987 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.541987 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.542471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.542716 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.542961 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.543202 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.543202 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.543202 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.543956 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.544206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.544206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.544650 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.544887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.545123 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.545383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.545383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.545833 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.546075 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.546311 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.546556 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.546792 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.547023 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.547023 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.547456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.547733 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.547978 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.548221 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.548221 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.548672 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.548852 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.548974 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.549088 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.549169 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.549243 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.549243 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.549473 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.549552 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.549644 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.549726 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.549806 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.549879 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.549958 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.549958 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.550219 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.550219 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.550362 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.550362 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.550507 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.550614 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.550698 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.550773 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.550851 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.550924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.551003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.551089 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.551170 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.551243 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.551315 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.551387 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.551459 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.551576 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.551671 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.551754 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.551827 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.551898 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.551978 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.552079 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.552165 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.552266 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.552348 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.552431 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.552513 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.552600 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.552673 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.552751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.552824 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.552896 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.552977 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.553051 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.553130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.553210 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.553285 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.553365 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.553438 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.553516 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.553589 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.553662 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.553741 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.553826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.553906 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.553988 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.553988 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.554119 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.554199 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.554279 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.554359 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.554461 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.554536 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.554608 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.554690 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.554763 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.554835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.554953 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.555063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.555154 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.555237 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.555354 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.555466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.555632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.555710 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.555808 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.555898 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.555973 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.556060 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.556133 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.556228 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.556343 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.556439 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.556439 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.556594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.556667 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.556746 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.556832 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.556912 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.556986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.557065 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.557138 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.557138 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.557281 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.557362 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.557435 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.557512 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.557512 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.557660 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.557734 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.557805 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.557877 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.557948 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.558019 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.558103 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.558183 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.558262 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.558335 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.558413 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.558486 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.558567 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.558640 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.558640 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.558803 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.558879 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.558879 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.559035 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.559108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.559187 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.559259 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.559337 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.559418 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.559548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.559679 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.559787 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.559863 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.559936 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.560150 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.560303 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.560436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.560561 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.560690 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.560690 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.560902 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.560979 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.561059 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.561140 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.561214 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.561285 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.561426 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.561508 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.561581 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.561653 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.561653 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.561828 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.561911 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.561985 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.562064 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.562143 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.562216 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.562302 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.562375 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.562453 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.562531 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.562604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.562724 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.562852 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.562966 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.563085 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.563212 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.563347 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.563483 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.563656 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.564478 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.564606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.564722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.564843 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.565472 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.565630 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.565774 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.565900 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.566039 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.566186 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.566312 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.566426 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.566537 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.566537 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.566745 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.566864 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.566987 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.567108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.567108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.567325 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.567437 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.567684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.567813 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.567813 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.567813 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.567813 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.568233 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.568464 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.568587 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.568708 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.568813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.568901 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.569039 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.569172 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.569286 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.569405 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.569519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.569630 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.569748 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.569870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.569982 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.570076 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.570076 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.570343 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.570452 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.570541 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.570623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.570702 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.570775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.570853 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.570963 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.570963 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 12:18:01.571100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.571100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.571100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.571100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.571100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.571100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.571100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.571100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.571713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.571713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.571713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.572295 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.572395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.572718 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.573035 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.573356 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.573678 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.574017 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.574342 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.574669 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.575013 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.575313 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.575668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.576000 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.576322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.576646 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.576968 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.577291 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.577615 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.577983 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.578711 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.578711 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.579141 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.579656 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.580176 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.580348 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.582003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.582003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.582640 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.582640 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.583038 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.583386 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.583799 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.584255 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.584696 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.585025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.585481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.585918 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.586241 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.586693 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.587050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.587508 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.587868 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.588198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.588892 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.588892 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.589300 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.589524 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.589869 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.590387 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.590663 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.590888 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.591123 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.591446 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.591854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.592095 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.592468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.592712 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.593034 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.593388 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.593736 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.594175 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.594536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.594970 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.595294 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.595640 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.596003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.596309 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.596628 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.596945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.597263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.597578 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.598000 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.598240 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.598596 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.599288 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.599288 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.599673 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.600046 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.600779 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.600779 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.601232 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.601471 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.601707 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.601923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.602294 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.602582 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.603104 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.603363 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.603625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.603974 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.604453 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.604891 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.605221 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.605571 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.605910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.606233 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.606571 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.606904 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.607240 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.607584 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.607989 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.608316 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.608663 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.609480 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.609480 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.610012 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.610226 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.610449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.611079 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.611079 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.611448 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.611742 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.613710 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.613710 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.613710 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.613710 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.613710 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.613710 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.614911 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.614911 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.614911 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.615662 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.615662 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.616104 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:18:01.616104 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 12:18:01.633822 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO dbcounter [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] Registered counter for database nova_api Sep 05 12:18:01.657868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_db.sqlalchemy.engines [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:18:01.665003 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writer thread running {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:18:01.682557 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO dbcounter [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] Registered counter for database nova_api Sep 05 12:18:01.708614 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_db.sqlalchemy.engines [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:18:01.716602 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writer thread running {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:18:01.728187 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.context [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9266b3e-0d18-400e-a40f-fa6d19190a0e(cell1) {{(pid=120535) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 12:18:01.732488 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:18:01.732969 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:18:01.734575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:18:01.735356 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:18:01.735929 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:18:01.738093 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:18:01.740327 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO dbcounter [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] Registered counter for database nova_cell0 Sep 05 12:18:01.744926 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO dbcounter [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] Registered counter for database nova_cell1 Sep 05 12:18:01.753114 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_db.sqlalchemy.engines [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:18:01.759091 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writer thread running {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:18:01.793041 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.context [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9266b3e-0d18-400e-a40f-fa6d19190a0e(cell1) {{(pid=120534) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 12:18:01.797367 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:18:01.797864 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:18:01.799576 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:18:01.800372 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:18:01.800832 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:18:01.802947 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:18:01.805209 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO dbcounter [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] Registered counter for database nova_cell0 Sep 05 12:18:01.810636 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO dbcounter [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] Registered counter for database nova_cell1 Sep 05 12:18:01.818937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_db.sqlalchemy.engines [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:18:01.825012 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writer thread running {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:18:01.825786 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_db.sqlalchemy.engines [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:18:01.910968 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_db.sqlalchemy.engines [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:18:01.917573 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writer thread running {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:18:01.928238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO dbcounter [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] Registered counter for database nova_cell0 Sep 05 12:18:01.936064 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_db.sqlalchemy.engines [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:18:01.942023 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writer thread running {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:18:01.992789 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writer thread running {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:18:02.004074 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO dbcounter [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] Registered counter for database nova_cell0 Sep 05 12:18:02.012659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_db.sqlalchemy.engines [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:18:02.018161 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writer thread running {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:18:02.272682 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: WARNING keystonemiddleware.auth_token [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:18:02.280433 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: WARNING keystonemiddleware.auth_token [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:18:02.350302 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: WARNING keystonemiddleware.auth_token [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:18:02.357969 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: WARNING keystonemiddleware.auth_token [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:18:02.633053 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: WARNING keystonemiddleware.auth_token [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:18:02.639542 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: WARNING keystonemiddleware.auth_token [None req-15e612a5-3ed3-447f-a527-44ae5d0d7640 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:18:02.645922 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0fd09b9c0 pid: 120535 (default app) Sep 05 12:18:02.714652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: WARNING keystonemiddleware.auth_token [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:18:02.721120 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: WARNING keystonemiddleware.auth_token [None req-57cc6643-6ab9-4175-a19b-f5e35ae032e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:18:02.727328 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0fd09b9c0 pid: 120534 (default app) Sep 05 12:18:41.093491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=3 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:41.094673 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=3 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:41.096821 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=3 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:41.098348 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=3 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:42.487402 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-3fa97f11-08d3-4e7f-b9b2-9403d54a3db1 tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] Action: 'create', calling method: .version_select at 0x7fba4c8da3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-114174133", "metadata": {"Type": "work"}}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:18:44.333120 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=3 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:44.334039 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=3 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:44.334790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=3 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:44.335931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=3 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:44.700491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-3fa97f11-08d3-4e7f-b9b2-9403d54a3db1 tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.632185 Sep 05 12:18:44.702455 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Sep 5 12:18:41 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3638 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 05 12:18:44.737884 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b1ca3f15-2b87-4584-8163-791e6ab67dc5 tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] Calling method '.version_select at 0x7fba4c7b9280>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:44.953712 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b1ca3f15-2b87-4584-8163-791e6ab67dc5 tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81" status: 200 len: 352 microversion: 2.1 time: 0.225765 Sep 05 12:18:44.962567 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:18:44 2022] GET /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81 => generated 352 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:45.971887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6c8cb938-959e-4b73-b8a3-1d0fd97258c5 tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] Calling method '.version_select at 0x7fba4c7b9940>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:46.091625 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6c8cb938-959e-4b73-b8a3-1d0fd97258c5 tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81" status: 200 len: 352 microversion: 2.1 time: 0.125033 Sep 05 12:18:46.099121 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 3/3] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:18:45 2022] GET /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81 => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:46.645444 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-23989824-8060-4e05-9f32-45a8c0499cd1 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Action: 'create', calling method: .version_select at 0x7fba4c8da280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1116579533"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:18:47.107415 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2ebaf612-e4d5-4d67-8f26-e5d353b7b6c2 tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] Calling method '.version_select at 0x7fba4c741040>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:47.643350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2ebaf612-e4d5-4d67-8f26-e5d353b7b6c2 tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81" status: 200 len: 353 microversion: 2.1 time: 0.538715 Sep 05 12:18:47.657129 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 4/4] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:18:47 2022] GET /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81 => generated 353 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:47.677982 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6be34bd1-4f41-433f-a389-93dd60e7158d tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] Calling method '.version_select at 0x7fba4c7411f0>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:48.120756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6be34bd1-4f41-433f-a389-93dd60e7158d tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81" status: 200 len: 353 microversion: 2.1 time: 0.454958 Sep 05 12:18:48.121476 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 5/5] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:18:47 2022] GET /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81 => generated 353 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:48.139022 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-941e3504-b1a2-4904-8545-de0702f058a4 tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] Calling method '.version_select at 0x7fba4c7419d0>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:48.602743 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-23989824-8060-4e05-9f32-45a8c0499cd1 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.275908 Sep 05 12:18:48.603632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 1/6] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Sep 5 12:18:44 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4279 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 05 12:18:48.637507 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-230dfd11-48fc-446c-b1a0-4cc6e782027b tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c7b8160>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:48.769735 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-941e3504-b1a2-4904-8545-de0702f058a4 tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81" status: 202 len: 0 microversion: 2.1 time: 0.637316 Sep 05 12:18:48.770804 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 6/7] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Sep 5 12:18:48 2022] DELETE /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81 => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:18:48.779747 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4d50adcb-ca03-4e6d-a164-2ff19ee771a0 tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] Calling method '.version_select at 0x7fba4c7430d0>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:48.876330 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-230dfd11-48fc-446c-b1a0-4cc6e782027b tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7" status: 200 len: 345 microversion: 2.1 time: 0.248168 Sep 05 12:18:48.877696 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 2/8] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:18:48 2022] GET /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 => generated 345 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:18:48.941495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4d50adcb-ca03-4e6d-a164-2ff19ee771a0 tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81" status: 200 len: 352 microversion: 2.1 time: 0.165653 Sep 05 12:18:48.942678 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 7/9] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:18:48 2022] GET /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81 => generated 352 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:49.006788 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3eca71c6-9fbe-4dcf-ac21-3f694bdf2340 tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] Calling method '.version_select at 0x7fba4c7b8820>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:49.115200 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-3eca71c6-9fbe-4dcf-ac21-3f694bdf2340 tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a27f549-b6ee-4153-8002-de0e694f428e" status: 200 len: 351 microversion: 2.1 time: 0.113464 Sep 05 12:18:49.115856 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 3/10] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:18:49 2022] GET /compute/v2.1/os-volumes/9a27f549-b6ee-4153-8002-de0e694f428e => generated 351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:18:49.911613 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ded668b6-6bd3-436a-87fd-9ee350c19194 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c743670>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:49.957752 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c16246b2-ee0f-47a4-ad7f-18d2907f8d8e tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] Calling method '.version_select at 0x7fba4c7b8f70>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:50.074717 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-c16246b2-ee0f-47a4-ad7f-18d2907f8d8e tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] HTTP exception thrown: Volume 27d854f1-6704-4500-9707-a08eddb7fd81 could not be found. Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c16246b2-ee0f-47a4-ad7f-18d2907f8d8e tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] Request method failure captured: Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81 HTTP/1.1 Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFekgzY9f0J0Nb2AQz7N4DbZKwdY2f2YS-FQ2PVOFm2AWG0VxwmbMS5euyHW-uq1871_97bcRFkkwv-ME8kAx3aW6Ehs7sHiq5Yiz0MgQCw4ktyPyP8ISj3cBDmsGTqFnKA-EMwatMpuPUYZU4hXG6ZcibK2w2-w4prmxJAkzSy9cznk Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 47557a3ca7624ad9b227ea0e51fd414e Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-VolumesGetTestJSON-780025985 Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:18:50.080135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:18:50.081603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47557a3ca7624ad9b227ea0e51fd414e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47557a3ca7624ad9b227ea0e51fd414e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47557a3ca7624ad9b227ea0e51fd414e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47557a3ca7624ad9b227ea0e51fd414e"}]}] Sep 05 12:18:50.081603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-VolumesGetTestJSON-780025985 Sep 05 12:18:50.081603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 47557a3ca7624ad9b227ea0e51fd414e Sep 05 12:18:50.081603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-VolumesGetTestJSON-780025985 Sep 05 12:18:50.081603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-VolumesGetTestJSON-780025985-project Sep 05 12:18:50.081603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:18:50.081603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:18:50.081603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 231eca85785c49628baaee7d6066c3f1 Sep 05 12:18:50.081603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-VolumesGetTestJSON-780025985-project Sep 05 12:18:50.081603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: Sep 05 12:18:50.081603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Volume 27d854f1-6704-4500-9707-a08eddb7fd81 could not be found. Sep 05 12:18:50.081603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '27d854f1-6704-4500-9707-a08eddb7fd81'} Sep 05 12:18:50.081603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27d854f1-6704-4500-9707-a08eddb7fd81 could not be found. (HTTP 404) (Request-ID: req-0b2ab452-3797-40a6-9e44-9702039f2dec) Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:50.082417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:18:50.083416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27d854f1-6704-4500-9707-a08eddb7fd81 could not be found. Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 12:18:50.084361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:18:50.085528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27d854f1-6704-4500-9707-a08eddb7fd81 could not be found. Sep 05 12:18:50.085528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:50.085528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:50.085528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:50.085528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:50.085528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:18:50.085528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:18:50.085528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:18:50.085528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:18:50.085528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27d854f1-6704-4500-9707-a08eddb7fd81 could not be found. Sep 05 12:18:50.085528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:50.085528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c16246b2-ee0f-47a4-ad7f-18d2907f8d8e tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] Returning 404 to user: Volume 27d854f1-6704-4500-9707-a08eddb7fd81 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:18:50.085528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c16246b2-ee0f-47a4-ad7f-18d2907f8d8e tempest-VolumesGetTestJSON-780025985 tempest-VolumesGetTestJSON-780025985-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81" status: 404 len: 109 microversion: 2.1 time: 0.127994 Sep 05 12:18:50.085528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 4/11] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:18:49 2022] GET /compute/v2.1/os-volumes/27d854f1-6704-4500-9707-a08eddb7fd81 => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:18:50.097043 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ded668b6-6bd3-436a-87fd-9ee350c19194 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7" status: 200 len: 346 microversion: 2.1 time: 0.190486 Sep 05 12:18:50.097615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 8/12] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:18:49 2022] GET /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 => generated 346 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:50.111664 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2f0f4ff7-c88a-4f3a-ad1f-0efb8c7df5d5 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Action: 'create', calling method: .version_select at 0x7fba4c711940>, body: {"snapshot": {"volume_id": "4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-576077407"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:18:50.932577 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2f0f4ff7-c88a-4f3a-ad1f-0efb8c7df5d5 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.825024 Sep 05 12:18:50.933959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 5/13] 10.222.0.16 () {60 vars in 1162 bytes} [Mon Sep 5 12:18:50 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:50.950800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-648640e5-61cf-4100-a8f5-0afa187243b0 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c7439d0>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:51.224459 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-648640e5-61cf-4100-a8f5-0afa187243b0 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1" status: 200 len: 286 microversion: 2.1 time: 0.281689 Sep 05 12:18:51.232330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 9/14] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Sep 5 12:18:50 2022] GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1 => generated 286 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:51.243989 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1c422f6f-8cbc-4317-a404-ed4de1acd133 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c711ca0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:51.406766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1c422f6f-8cbc-4317-a404-ed4de1acd133 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.172152 Sep 05 12:18:51.407199 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 6/15] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Sep 5 12:18:51 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:51.441046 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-936aeadf-8ff2-418b-b725-c35477c1977c tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c7460d0>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:51.559741 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-936aeadf-8ff2-418b-b725-c35477c1977c tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1" status: 200 len: 286 microversion: 2.1 time: 0.140953 Sep 05 12:18:51.562235 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 10/16] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Sep 5 12:18:51 2022] GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:52.146356 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a96cfab7-8638-42ee-8264-8eace2d54d97 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Action: 'create', calling method: .version_select at 0x7fba4c72a4c0>, body: {"keypair": {"name": "tempest-keypair-705731915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC08FeeBQ8VOtQXeHtfzCeIHgmNPOhVC+Ske6L9+gifYqOXCbHgV6a7TwLFqYeVpb9DvfeG+Tki+N3dbboddHf9+TwD7XcpTYJGo9Fe8NJuiXiphPj27Z2I9ifXoAuHTig=="}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:18:52.156122 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0be7dde6-dfdb-46e8-b01c-00edd1d40bb1 tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] Calling method '.version_select at 0x7fba4c743e50>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:52.245983 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-a96cfab7-8638-42ee-8264-8eace2d54d97 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Getting quotas for project ca5b70833b074d199437d3f10e511306. Resources: {'key_pairs'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:18:52.265011 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-a96cfab7-8638-42ee-8264-8eace2d54d97 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Getting quotas for user 83d3b245c185424a9b6e5d69d691f031 and project ca5b70833b074d199437d3f10e511306. Resources: {'key_pairs'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:18:52.344761 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0be7dde6-dfdb-46e8-b01c-00edd1d40bb1 tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3465784b-1faf-481a-bf30-540eaa9c9d46" status: 200 len: 351 microversion: 2.1 time: 0.196280 Sep 05 12:18:52.346913 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 11/17] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:18:52 2022] GET /compute/v2.1/os-volumes/3465784b-1faf-481a-bf30-540eaa9c9d46 => generated 351 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:52.431828 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a96cfab7-8638-42ee-8264-8eace2d54d97 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.629940 Sep 05 12:18:52.433127 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 7/18] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Sep 5 12:18:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 633 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 05 12:18:52.580945 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c3cc08a9-16c3-47bc-81ae-d5fabcd833cf tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c743160>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:52.733445 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c3cc08a9-16c3-47bc-81ae-d5fabcd833cf tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1" status: 200 len: 286 microversion: 2.1 time: 0.161525 Sep 05 12:18:52.735377 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 12/19] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Sep 5 12:18:52 2022] GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:53.763713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0b8c982c-c816-4a2b-b68e-bd4a5e08f9a8 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c687790>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:53.873902 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0b8c982c-c816-4a2b-b68e-bd4a5e08f9a8 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1" status: 200 len: 286 microversion: 2.1 time: 0.126017 Sep 05 12:18:53.885588 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 8/20] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Sep 5 12:18:53 2022] GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:54.901283 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-83135d76-2384-4261-9a51-cd3e4e8622f7 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c7465e0>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:55.024335 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-83135d76-2384-4261-9a51-cd3e4e8622f7 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1" status: 200 len: 286 microversion: 2.1 time: 0.131660 Sep 05 12:18:55.041539 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 13/21] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Sep 5 12:18:54 2022] GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:56.051718 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-45aef7a2-9709-4154-b92f-f57275dd8ff8 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c687e50>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:56.257295 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-45aef7a2-9709-4154-b92f-f57275dd8ff8 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1" status: 200 len: 286 microversion: 2.1 time: 0.216170 Sep 05 12:18:56.259166 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 9/22] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Sep 5 12:18:56 2022] GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1 => generated 286 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:57.271225 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3cada5df-877e-48c4-9f27-9648098f175b tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c6a8550>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:57.362751 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-3cada5df-877e-48c4-9f27-9648098f175b tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1" status: 200 len: 286 microversion: 2.1 time: 0.096288 Sep 05 12:18:57.363512 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 10/23] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Sep 5 12:18:57 2022] GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:57.456521 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c90fe0a5-98ca-4669-b0ac-48a591b69b93 tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Action: 'create', calling method: .version_select at 0x7fba4c746820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-842435945", "metadata": {"Type": "work"}}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c90fe0a5-98ca-4669-b0ac-48a591b69b93 tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Request method failure captured: Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 121 Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFekwhGMBQZbzbHTbeibPv6ojiQIL9Y-7Zviy-6zupZlSJCIKpx22F0GYYtrslwN_MW4ApKsGPnZHAg_1hoL1X4r_xDEb2Oyob8GyThf24VdDlcIcSnhu3_JMztbiUsMrZiXFcb3AygXEVc5Ad4q7jXelJ0cT5ckJJqna44_kVyG_SiU Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: e6488bf30f0d415e8729d000495af25f Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:18:57.464816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:18:57.466069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6488bf30f0d415e8729d000495af25f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6488bf30f0d415e8729d000495af25f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6488bf30f0d415e8729d000495af25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6488bf30f0d415e8729d000495af25f"}]}] Sep 05 12:18:57.466069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.466069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: e6488bf30f0d415e8729d000495af25f Sep 05 12:18:57.466069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.466069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-VolumesNegativeTest-695879295-project Sep 05 12:18:57.466069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:18:57.466069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:18:57.466069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: 0886ce47c12944c8be5ca15707abab0f Sep 05 12:18:57.466069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-VolumesNegativeTest-695879295-project Sep 05 12:18:57.466069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Sep 05 12:18:57.466069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-842435945", "metadata": {"Type": "work"}}} Sep 05 12:18:57.466069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: Sep 05 12:18:57.466069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-842435945', 'metadata': {'Type': 'work'}}}} Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise error Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi '#$%' Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:18:57.466755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 05 12:18:57.468042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 05 12:18:57.469049 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 05 12:18:57.469049 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.472872 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c90fe0a5-98ca-4669-b0ac-48a591b69b93 tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:18:57.474568 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c90fe0a5-98ca-4669-b0ac-48a591b69b93 tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.703026 Sep 05 12:18:57.476157 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 14/24] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Sep 5 12:18:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 705 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:18:57.486612 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7e1078cf-1c6b-400d-a1e5-16bd5e9b1751 tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Action: 'create', calling method: .version_select at 0x7fba4c6a8b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-459516616", "metadata": {"Type": "work"}}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7e1078cf-1c6b-400d-a1e5-16bd5e9b1751 tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Request method failure captured: Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 119 Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFekwhGMBQZbzbHTbeibPv6ojiQIL9Y-7Zviy-6zupZlSJCIKpx22F0GYYtrslwN_MW4ApKsGPnZHAg_1hoL1X4r_xDEb2Oyob8GyThf24VdDlcIcSnhu3_JMztbiUsMrZiXFcb3AygXEVc5Ad4q7jXelJ0cT5ckJJqna44_kVyG_SiU Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: e6488bf30f0d415e8729d000495af25f Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:18:57.493914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:18:57.495078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6488bf30f0d415e8729d000495af25f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6488bf30f0d415e8729d000495af25f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6488bf30f0d415e8729d000495af25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6488bf30f0d415e8729d000495af25f"}]}] Sep 05 12:18:57.495078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.495078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: e6488bf30f0d415e8729d000495af25f Sep 05 12:18:57.495078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.495078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-VolumesNegativeTest-695879295-project Sep 05 12:18:57.495078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:18:57.495078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:18:57.495078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 0886ce47c12944c8be5ca15707abab0f Sep 05 12:18:57.495078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-VolumesNegativeTest-695879295-project Sep 05 12:18:57.495078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Sep 05 12:18:57.495078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-459516616", "metadata": {"Type": "work"}}} Sep 05 12:18:57.495078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: Sep 05 12:18:57.495078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-459516616', 'metadata': {'Type': 'work'}}}} Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise error Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi '0' Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:18:57.495750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 05 12:18:57.496771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 05 12:18:57.497706 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 05 12:18:57.497706 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.501797 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7e1078cf-1c6b-400d-a1e5-16bd5e9b1751 tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:18:57.503215 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7e1078cf-1c6b-400d-a1e5-16bd5e9b1751 tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021530 Sep 05 12:18:57.504513 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 11/25] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Sep 5 12:18:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:18:57.518021 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a91bcb83-721e-4425-9222-cef3865f71dd tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Action: 'create', calling method: .version_select at 0x7fba4c746040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-997077241", "metadata": {"Type": "work"}}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a91bcb83-721e-4425-9222-cef3865f71dd tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Request method failure captured: Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 118 Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFekwhGMBQZbzbHTbeibPv6ojiQIL9Y-7Zviy-6zupZlSJCIKpx22F0GYYtrslwN_MW4ApKsGPnZHAg_1hoL1X4r_xDEb2Oyob8GyThf24VdDlcIcSnhu3_JMztbiUsMrZiXFcb3AygXEVc5Ad4q7jXelJ0cT5ckJJqna44_kVyG_SiU Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: e6488bf30f0d415e8729d000495af25f Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:18:57.525756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:18:57.526912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6488bf30f0d415e8729d000495af25f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6488bf30f0d415e8729d000495af25f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6488bf30f0d415e8729d000495af25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6488bf30f0d415e8729d000495af25f"}]}] Sep 05 12:18:57.526912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.526912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: e6488bf30f0d415e8729d000495af25f Sep 05 12:18:57.526912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.526912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-VolumesNegativeTest-695879295-project Sep 05 12:18:57.526912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:18:57.526912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:18:57.526912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: 0886ce47c12944c8be5ca15707abab0f Sep 05 12:18:57.526912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-VolumesNegativeTest-695879295-project Sep 05 12:18:57.526912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Sep 05 12:18:57.526912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-997077241", "metadata": {"Type": "work"}}} Sep 05 12:18:57.526912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: Sep 05 12:18:57.526912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-997077241', 'metadata': {'Type': 'work'}}}} Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise error Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi '' Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:18:57.527787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 05 12:18:57.528865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 05 12:18:57.529745 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 05 12:18:57.529745 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.532747 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a91bcb83-721e-4425-9222-cef3865f71dd tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:18:57.539404 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a91bcb83-721e-4425-9222-cef3865f71dd tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026272 Sep 05 12:18:57.540199 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 15/26] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Sep 5 12:18:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 05 12:18:57.551609 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9b5d2227-0143-4d03-a237-6b1e624f81b7 tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Calling method '.version_select at 0x7fba4c6a8790>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:57.593638 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-9b5d2227-0143-4d03-a237-6b1e624f81b7 tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] HTTP exception thrown: Volume tempest-invalid-963681135 could not be found. Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9b5d2227-0143-4d03-a237-6b1e624f81b7 tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Request method failure captured: Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-963681135 HTTP/1.1 Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFekwhGMBQZbzbHTbeibPv6ojiQIL9Y-7Zviy-6zupZlSJCIKpx22F0GYYtrslwN_MW4ApKsGPnZHAg_1hoL1X4r_xDEb2Oyob8GyThf24VdDlcIcSnhu3_JMztbiUsMrZiXFcb3AygXEVc5Ad4q7jXelJ0cT5ckJJqna44_kVyG_SiU Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: e6488bf30f0d415e8729d000495af25f Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:18:57.596723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:18:57.597854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6488bf30f0d415e8729d000495af25f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6488bf30f0d415e8729d000495af25f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6488bf30f0d415e8729d000495af25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6488bf30f0d415e8729d000495af25f"}]}] Sep 05 12:18:57.597854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.597854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: e6488bf30f0d415e8729d000495af25f Sep 05 12:18:57.597854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.597854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-VolumesNegativeTest-695879295-project Sep 05 12:18:57.597854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:18:57.597854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:18:57.597854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 0886ce47c12944c8be5ca15707abab0f Sep 05 12:18:57.597854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-VolumesNegativeTest-695879295-project Sep 05 12:18:57.597854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: Sep 05 12:18:57.597854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Volume tempest-invalid-963681135 could not be found. Sep 05 12:18:57.597854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': 'tempest-invalid-963681135'} Sep 05 12:18:57.597854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-963681135 could not be found. (HTTP 404) (Request-ID: req-4f6a522d-a2a9-41fe-b077-3d88818fd437) Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.598479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 12:18:57.599389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-963681135 could not be found. Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:18:57.600649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-963681135 could not be found. Sep 05 12:18:57.601651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.601651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.601651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.601651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.601651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:18:57.601651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:18:57.601651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:18:57.601651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:18:57.601651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-963681135 could not be found. Sep 05 12:18:57.601651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.601651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9b5d2227-0143-4d03-a237-6b1e624f81b7 tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Returning 404 to user: Volume tempest-invalid-963681135 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:18:57.601651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9b5d2227-0143-4d03-a237-6b1e624f81b7 tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-963681135" status: 404 len: 98 microversion: 2.1 time: 0.051088 Sep 05 12:18:57.601651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 12/27] 10.222.0.16 () {58 vars in 1215 bytes} [Mon Sep 5 12:18:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-963681135 => generated 98 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 05 12:18:57.612129 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9bd3b567-68e5-497d-aa6f-94b0507b2b4c tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005027 Sep 05 12:18:57.613016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 16/28] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Sep 5 12:18:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 05 12:18:57.623151 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b4b9b7ed-4235-4453-8db4-2efb35e6a055 tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004403 Sep 05 12:18:57.623789 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 13/29] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Sep 5 12:18:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 05 12:18:57.646194 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9000f57c-7b13-4957-be8f-b7a541f0d60f tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Calling method '.version_select at 0x7fba4c7461f0>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:57.700452 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-9000f57c-7b13-4957-be8f-b7a541f0d60f tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] HTTP exception thrown: Volume e067ca4f-77a6-42c4-8348-5932a0ff772c could not be found. Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9000f57c-7b13-4957-be8f-b7a541f0d60f tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Request method failure captured: Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: DELETE /compute/v2.1/os-volumes/e067ca4f-77a6-42c4-8348-5932a0ff772c HTTP/1.1 Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFekwhGMBQZbzbHTbeibPv6ojiQIL9Y-7Zviy-6zupZlSJCIKpx22F0GYYtrslwN_MW4ApKsGPnZHAg_1hoL1X4r_xDEb2Oyob8GyThf24VdDlcIcSnhu3_JMztbiUsMrZiXFcb3AygXEVc5Ad4q7jXelJ0cT5ckJJqna44_kVyG_SiU Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: e6488bf30f0d415e8729d000495af25f Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:18:57.704086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:18:57.705834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6488bf30f0d415e8729d000495af25f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6488bf30f0d415e8729d000495af25f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6488bf30f0d415e8729d000495af25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6488bf30f0d415e8729d000495af25f"}]}] Sep 05 12:18:57.705834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.705834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: e6488bf30f0d415e8729d000495af25f Sep 05 12:18:57.705834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.705834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-VolumesNegativeTest-695879295-project Sep 05 12:18:57.705834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:18:57.705834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:18:57.705834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: 0886ce47c12944c8be5ca15707abab0f Sep 05 12:18:57.705834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-VolumesNegativeTest-695879295-project Sep 05 12:18:57.705834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: Sep 05 12:18:57.705834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Volume e067ca4f-77a6-42c4-8348-5932a0ff772c could not be found. Sep 05 12:18:57.705834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': 'e067ca4f-77a6-42c4-8348-5932a0ff772c'} Sep 05 12:18:57.705834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e067ca4f-77a6-42c4-8348-5932a0ff772c could not be found. (HTTP 404) (Request-ID: req-ccecc14c-c4ef-41d1-9548-ec8a25f08d6e) Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.706468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 12:18:57.707540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e067ca4f-77a6-42c4-8348-5932a0ff772c could not be found. Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 05 12:18:57.708435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:18:57.709318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e067ca4f-77a6-42c4-8348-5932a0ff772c could not be found. Sep 05 12:18:57.709318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.709318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.709318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.709318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.709318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:18:57.709318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:18:57.709318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:18:57.709318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:18:57.709318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e067ca4f-77a6-42c4-8348-5932a0ff772c could not be found. Sep 05 12:18:57.709318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.710931 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9000f57c-7b13-4957-be8f-b7a541f0d60f tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Returning 404 to user: Volume e067ca4f-77a6-42c4-8348-5932a0ff772c could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:18:57.712116 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9000f57c-7b13-4957-be8f-b7a541f0d60f tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/e067ca4f-77a6-42c4-8348-5932a0ff772c" status: 404 len: 109 microversion: 2.1 time: 0.080693 Sep 05 12:18:57.713305 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 17/30] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Sep 5 12:18:57 2022] DELETE /compute/v2.1/os-volumes/e067ca4f-77a6-42c4-8348-5932a0ff772c => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:18:57.724348 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-eaed7567-f6be-42fa-b549-5e2d611e7aaa tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Calling method '.version_select at 0x7fba4c6a84c0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:57.774925 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-eaed7567-f6be-42fa-b549-5e2d611e7aaa tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] HTTP exception thrown: Volume 2d5b9dbd-741f-4ddd-b490-42b08e5466b7 could not be found. Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-eaed7567-f6be-42fa-b549-5e2d611e7aaa tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Request method failure captured: Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/os-volumes/2d5b9dbd-741f-4ddd-b490-42b08e5466b7 HTTP/1.1 Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFekwhGMBQZbzbHTbeibPv6ojiQIL9Y-7Zviy-6zupZlSJCIKpx22F0GYYtrslwN_MW4ApKsGPnZHAg_1hoL1X4r_xDEb2Oyob8GyThf24VdDlcIcSnhu3_JMztbiUsMrZiXFcb3AygXEVc5Ad4q7jXelJ0cT5ckJJqna44_kVyG_SiU Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: e6488bf30f0d415e8729d000495af25f Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:18:57.777490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:18:57.778632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6488bf30f0d415e8729d000495af25f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6488bf30f0d415e8729d000495af25f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6488bf30f0d415e8729d000495af25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6488bf30f0d415e8729d000495af25f"}]}] Sep 05 12:18:57.778632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.778632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: e6488bf30f0d415e8729d000495af25f Sep 05 12:18:57.778632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-VolumesNegativeTest-695879295 Sep 05 12:18:57.778632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-VolumesNegativeTest-695879295-project Sep 05 12:18:57.778632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:18:57.778632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:18:57.778632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 0886ce47c12944c8be5ca15707abab0f Sep 05 12:18:57.778632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-VolumesNegativeTest-695879295-project Sep 05 12:18:57.778632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: Sep 05 12:18:57.778632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Volume 2d5b9dbd-741f-4ddd-b490-42b08e5466b7 could not be found. Sep 05 12:18:57.778632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '2d5b9dbd-741f-4ddd-b490-42b08e5466b7'} Sep 05 12:18:57.778632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d5b9dbd-741f-4ddd-b490-42b08e5466b7 could not be found. (HTTP 404) (Request-ID: req-f2b06b58-7ebc-49cb-8785-51188757c2d7) Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.779289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:18:57.780198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d5b9dbd-741f-4ddd-b490-42b08e5466b7 could not be found. Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 12:18:57.783237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:18:57.784359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d5b9dbd-741f-4ddd-b490-42b08e5466b7 could not be found. Sep 05 12:18:57.784359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.784359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:18:57.784359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.784359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:18:57.784359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:18:57.784359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:18:57.784359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:18:57.784359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:18:57.784359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d5b9dbd-741f-4ddd-b490-42b08e5466b7 could not be found. Sep 05 12:18:57.784359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:18:57.788055 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-eaed7567-f6be-42fa-b549-5e2d611e7aaa tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] Returning 404 to user: Volume 2d5b9dbd-741f-4ddd-b490-42b08e5466b7 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:18:57.789967 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-eaed7567-f6be-42fa-b549-5e2d611e7aaa tempest-VolumesNegativeTest-695879295 tempest-VolumesNegativeTest-695879295-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2d5b9dbd-741f-4ddd-b490-42b08e5466b7" status: 404 len: 109 microversion: 2.1 time: 0.071126 Sep 05 12:18:57.792408 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 14/31] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:18:57 2022] GET /compute/v2.1/os-volumes/2d5b9dbd-741f-4ddd-b490-42b08e5466b7 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:18:58.379485 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-06ee59f7-a3a0-4258-8ce0-9a7511fed3bf tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c70d1f0>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:58.442068 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-06ee59f7-a3a0-4258-8ce0-9a7511fed3bf tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1" status: 200 len: 287 microversion: 2.1 time: 0.069288 Sep 05 12:18:58.442950 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 18/32] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Sep 5 12:18:58 2022] GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:58.454365 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-287ace64-f1ef-4812-a812-4fa0ed50ca0e tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c6b75e0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:58.593537 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-287ace64-f1ef-4812-a812-4fa0ed50ca0e tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1" status: 202 len: 0 microversion: 2.1 time: 0.143125 Sep 05 12:18:58.594369 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 15/33] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Sep 5 12:18:58 2022] DELETE /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:18:58.604199 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8451b11b-8277-4455-a5bb-b94736347c84 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c746550>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:58.682891 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8451b11b-8277-4455-a5bb-b94736347c84 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1" status: 200 len: 286 microversion: 2.1 time: 0.083620 Sep 05 12:18:58.683459 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 19/34] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Sep 5 12:18:58 2022] GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:18:59.454651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1630639354", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "networks": [{"uuid": "f42e9bdc-0837-42f2-aa18-7771cd52d5d4"}]}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:18:59.596751 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.network.neutron [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] validate_networks() for [('f42e9bdc-0837-42f2-aa18-7771cd52d5d4', None, None, None, None, None)] {{(pid=120534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:18:59.698193 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f636ce64-9b29-4c30-93a8-c2041ebdccfc tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c7463a0>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:18:59.787786 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f636ce64-9b29-4c30-93a8-c2041ebdccfc tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1" status: 200 len: 286 microversion: 2.1 time: 0.093543 Sep 05 12:18:59.789074 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 20/35] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Sep 5 12:18:59 2022] GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:00.458952 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-879590485", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93dc69bc-3411-4656-bd5d-857f16e23b35"}], "security_groups": [{"name": "tempest-securitygroup--1624603315"}], "key_name": "tempest-keypair-705731915", "user_data": "}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:19:01.505061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.network.neutron [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] validate_networks() for [('93dc69bc-3411-4656-bd5d-857f16e23b35', None, None, None, None, None)] {{(pid=120535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:19:01.678889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Flavor limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:19:01.680270 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Image limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:19:01.681190 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Flavor pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:19:01.681806 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Image pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:19:01.682410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:19:01.743414 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:01.743992 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:01.744445 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:01.745259 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:01.745711 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:01.746133 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:01.875137 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Getting quotas for project 09ba610aa04549c3ab792787257f4372. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:19:01.907195 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Getting quotas for user 6fb28ddd5511425a93c7b486d78a99eb and project 09ba610aa04549c3ab792787257f4372. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:19:01.958054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Going to run 1 instances... {{(pid=120534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:19:01.961026 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:19:02.175861 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-fbef7679-8a12-4dc0-8b7c-aaa99d8573d7 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.112007 Sep 05 12:19:02.184748 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 16/36] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:18:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:19:02.206356 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-511cd8d9-4b8e-46b1-9605-96eb6fc07550 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4c5ec9d0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:02.319980 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-511cd8d9-4b8e-46b1-9605-96eb6fc07550 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1" status: 200 len: 286 microversion: 2.1 time: 0.122539 Sep 05 12:19:02.321922 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 17/37] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Sep 5 12:19:02 2022] GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:02.352171 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c338c569-c5d5-488c-9c93-84ea6d38e133 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:02.355395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c338c569-c5d5-488c-9c93-84ea6d38e133 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:02.544644 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c338c569-c5d5-488c-9c93-84ea6d38e133 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:02.575988 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c338c569-c5d5-488c-9c93-84ea6d38e133 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1215 microversion: 2.1 time: 0.252366 Sep 05 12:19:02.576585 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 18/38] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:02 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1215 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:03.340228 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3d44ff07-b885-4d13-bdf2-d9364dbaa276 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4bda09d0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:03.421685 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-3d44ff07-b885-4d13-bdf2-d9364dbaa276 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] HTTP exception thrown: Snapshot 8249de74-d45c-4be1-9013-e7487292c4f1 could not be found. Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3d44ff07-b885-4d13-bdf2-d9364dbaa276 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Request method failure captured: Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1 HTTP/1.1 Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFekkZYk-Y3_Z-eQ1KWLU09kWbmqnYriqDA9t2HBV3QGjMddw2T5wQVN_N-WiErBiiBMU_C6xIxozMD3xAuk2qe5q_SjEU7yYASUAzL-lOVJTubH_djtakxqvcfI_3dMSrcom143iVBU9Mhv2rVf5Y8XUt-iNDyZxIBWiSFUDaDcp5dQ Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 09d82afaf78a497395c3b4ba0b8294fd Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1146798112 Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:19:03.427450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:19:03.428761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d82afaf78a497395c3b4ba0b8294fd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d82afaf78a497395c3b4ba0b8294fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d82afaf78a497395c3b4ba0b8294fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d82afaf78a497395c3b4ba0b8294fd"}]}] Sep 05 12:19:03.428761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1146798112 Sep 05 12:19:03.428761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 09d82afaf78a497395c3b4ba0b8294fd Sep 05 12:19:03.428761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1146798112 Sep 05 12:19:03.428761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-VolumesSnapshotsTestJSON-1146798112-project Sep 05 12:19:03.428761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:19:03.428761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:19:03.428761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 02de21bffe154077866824e2033608fc Sep 05 12:19:03.428761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1146798112-project Sep 05 12:19:03.428761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: Sep 05 12:19:03.428761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Snapshot 8249de74-d45c-4be1-9013-e7487292c4f1 could not be found. Sep 05 12:19:03.428761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '8249de74-d45c-4be1-9013-e7487292c4f1'} Sep 05 12:19:03.428761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8249de74-d45c-4be1-9013-e7487292c4f1 could not be found. (HTTP 404) (Request-ID: req-ef56231c-33a8-42bc-a359-a7737eeec0e2) Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:03.429468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:19:03.430397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8249de74-d45c-4be1-9013-e7487292c4f1 could not be found. Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 05 12:19:03.431464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:19:03.432538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8249de74-d45c-4be1-9013-e7487292c4f1 could not be found. Sep 05 12:19:03.432538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:03.432538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:19:03.432538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:03.432538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:03.432538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:19:03.432538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:19:03.432538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:19:03.432538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:19:03.432538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8249de74-d45c-4be1-9013-e7487292c4f1 could not be found. Sep 05 12:19:03.432538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:03.436580 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3d44ff07-b885-4d13-bdf2-d9364dbaa276 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Returning 404 to user: Snapshot 8249de74-d45c-4be1-9013-e7487292c4f1 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:19:03.438679 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-3d44ff07-b885-4d13-bdf2-d9364dbaa276 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1" status: 404 len: 111 microversion: 2.1 time: 0.103078 Sep 05 12:19:03.440337 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 19/39] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Sep 5 12:19:03 2022] GET /compute/v2.1/os-snapshots/8249de74-d45c-4be1-9013-e7487292c4f1 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:19:03.452440 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-49164dcd-9888-416a-8e96-1584bbc050b4 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4bdb10d0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:03.652312 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-49164dcd-9888-416a-8e96-1584bbc050b4 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7" status: 202 len: 0 microversion: 2.1 time: 0.205026 Sep 05 12:19:03.652847 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 20/40] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Sep 5 12:19:03 2022] DELETE /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:19:03.658398 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f1c91856-8381-4d8b-a901-f58195cc54e1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:03.659022 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f1c91856-8381-4d8b-a901-f58195cc54e1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:03.845895 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f1c91856-8381-4d8b-a901-f58195cc54e1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:03.871255 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f1c91856-8381-4d8b-a901-f58195cc54e1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1215 microversion: 2.1 time: 0.217194 Sep 05 12:19:03.871901 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 21/41] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:03 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1215 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:03.884462 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e9a55148-3e15-48ce-9c6a-741c8fe068b7 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4bdb1e50>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:04.188898 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e9a55148-3e15-48ce-9c6a-741c8fe068b7 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7" status: 200 len: 345 microversion: 2.1 time: 0.310933 Sep 05 12:19:04.190067 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 22/42] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:19:03 2022] GET /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 => generated 345 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:04.227135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-23f46ca3-bdf8-4400-a895-ab92860532f0 tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] Calling method '.version_select at 0x7fba4bdb19d0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:04.397877 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-23f46ca3-bdf8-4400-a895-ab92860532f0 tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ef8d5b70-9f74-4898-99d9-cc94020ea8ec" status: 200 len: 351 microversion: 2.1 time: 0.205950 Sep 05 12:19:04.403941 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 23/43] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:19:04 2022] GET /compute/v2.1/os-volumes/ef8d5b70-9f74-4898-99d9-cc94020ea8ec => generated 351 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:04.425552 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7051beba-cf53-433a-8c31-0373dff4da2e tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] Calling method '.version_select at 0x7fba4bd43040>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:04.717220 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7051beba-cf53-433a-8c31-0373dff4da2e tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.305912 Sep 05 12:19:04.730683 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 24/44] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Sep 5 12:19:04 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:04.746712 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3b1707ec-b1fd-4f95-8051-d9f0e5c91b3b tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] Calling method '.version_select at 0x7fba4bd43af0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:05.037509 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-3b1707ec-b1fd-4f95-8051-d9f0e5c91b3b tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.299973 Sep 05 12:19:05.057561 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 25/45] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Sep 5 12:19:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:05.095603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-70c6be89-9f8c-4597-9319-0f4ca0b992ae tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:05.103934 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-70c6be89-9f8c-4597-9319-0f4ca0b992ae tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:05.134139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-70c6be89-9f8c-4597-9319-0f4ca0b992ae tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:05.135489 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-70c6be89-9f8c-4597-9319-0f4ca0b992ae tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:05.136043 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-70c6be89-9f8c-4597-9319-0f4ca0b992ae tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:05.136870 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-70c6be89-9f8c-4597-9319-0f4ca0b992ae tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:05.137375 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-70c6be89-9f8c-4597-9319-0f4ca0b992ae tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:05.137816 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-70c6be89-9f8c-4597-9319-0f4ca0b992ae tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:05.202431 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Flavor limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:19:05.216336 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Image limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:19:05.218435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Flavor pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:19:05.219234 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Image pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:19:05.219928 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:19:05.270575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:05.272200 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:05.273898 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:05.275246 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:05.289281 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:05.290272 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:05.398399 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Getting quotas for project ca5b70833b074d199437d3f10e511306. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:19:05.408999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Getting quotas for user 83d3b245c185424a9b6e5d69d691f031 and project ca5b70833b074d199437d3f10e511306. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:19:05.424272 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Going to run 1 instances... {{(pid=120535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:19:05.428598 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:19:05.551373 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-70c6be89-9f8c-4597-9319-0f4ca0b992ae tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:05.575665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-70c6be89-9f8c-4597-9319-0f4ca0b992ae tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1219 microversion: 2.1 time: 0.515934 Sep 05 12:19:05.589883 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 26/46] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:05 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1219 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:05.614588 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-db6c8abd-fc65-427b-b271-3e28ad92379b tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] Calling method '.version_select at 0x7fba4bd22700>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:05.727972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-264aa2db-84d4-4e37-8c78-a2dfc252be03 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.283359 Sep 05 12:19:05.749187 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 21/47] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Sep 5 12:19:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 5297 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 05 12:19:05.763457 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-495d11d7-b6cd-4f2e-be55-f3a1a6b1fa23 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4bdcad30>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:05.871091 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-495d11d7-b6cd-4f2e-be55-f3a1a6b1fa23 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] HTTP exception thrown: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-495d11d7-b6cd-4f2e-be55-f3a1a6b1fa23 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Request method failure captured: Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 HTTP/1.1 Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFekkZYk-Y3_Z-eQ1KWLU09kWbmqnYriqDA9t2HBV3QGjMddw2T5wQVN_N-WiErBiiBMU_C6xIxozMD3xAuk2qe5q_SjEU7yYASUAzL-lOVJTubH_djtakxqvcfI_3dMSrcom143iVBU9Mhv2rVf5Y8XUt-iNDyZxIBWiSFUDaDcp5dQ Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 09d82afaf78a497395c3b4ba0b8294fd Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1146798112 Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:19:05.874730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:19:05.875940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d82afaf78a497395c3b4ba0b8294fd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d82afaf78a497395c3b4ba0b8294fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d82afaf78a497395c3b4ba0b8294fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d82afaf78a497395c3b4ba0b8294fd"}]}] Sep 05 12:19:05.875940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1146798112 Sep 05 12:19:05.875940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 09d82afaf78a497395c3b4ba0b8294fd Sep 05 12:19:05.875940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1146798112 Sep 05 12:19:05.875940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-VolumesSnapshotsTestJSON-1146798112-project Sep 05 12:19:05.875940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:19:05.875940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:19:05.875940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: 02de21bffe154077866824e2033608fc Sep 05 12:19:05.875940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1146798112-project Sep 05 12:19:05.875940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: Sep 05 12:19:05.875940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:05.875940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7'} Sep 05 12:19:05.875940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. (HTTP 404) (Request-ID: req-888aff64-b000-4ab3-a955-f6cc4cf75d72) Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:19:05.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:19:05.877834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 12:19:05.878826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:19:05.879803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:05.879803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:19:05.879803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:19:05.879803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:19:05.879803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:05.879803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:19:05.879803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:19:05.879803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:19:05.879803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:19:05.879803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:05.879803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:19:05.883859 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-495d11d7-b6cd-4f2e-be55-f3a1a6b1fa23 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Returning 404 to user: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:19:05.887105 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-495d11d7-b6cd-4f2e-be55-f3a1a6b1fa23 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7" status: 404 len: 109 microversion: 2.1 time: 0.143643 Sep 05 12:19:05.889391 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 22/48] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:19:05 2022] GET /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 => generated 109 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:19:05.927636 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-db6c8abd-fc65-427b-b271-3e28ad92379b tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.336452 Sep 05 12:19:05.928569 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 27/49] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Sep 5 12:19:05 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:05.933346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ccd2c0f3-8eb9-49ff-be77-d5e8384815b5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:05.934177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ccd2c0f3-8eb9-49ff-be77-d5e8384815b5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:06.107285 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ccd2c0f3-8eb9-49ff-be77-d5e8384815b5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:06.129834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ccd2c0f3-8eb9-49ff-be77-d5e8384815b5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:06.139499 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ccd2c0f3-8eb9-49ff-be77-d5e8384815b5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:06.143767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ccd2c0f3-8eb9-49ff-be77-d5e8384815b5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1280 microversion: 2.20 time: 0.211524 Sep 05 12:19:06.145178 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 28/50] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:05 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1280 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:06.196813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-cb635f9e-ccde-4d58-a556-695a4fc671f4 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4bd2c3a0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:06.265275 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-cb635f9e-ccde-4d58-a556-695a4fc671f4 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] HTTP exception thrown: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-cb635f9e-ccde-4d58-a556-695a4fc671f4 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Request method failure captured: Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: DELETE /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 HTTP/1.1 Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFekkZYk-Y3_Z-eQ1KWLU09kWbmqnYriqDA9t2HBV3QGjMddw2T5wQVN_N-WiErBiiBMU_C6xIxozMD3xAuk2qe5q_SjEU7yYASUAzL-lOVJTubH_djtakxqvcfI_3dMSrcom143iVBU9Mhv2rVf5Y8XUt-iNDyZxIBWiSFUDaDcp5dQ Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 09d82afaf78a497395c3b4ba0b8294fd Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1146798112 Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:19:06.268100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:19:06.269554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d82afaf78a497395c3b4ba0b8294fd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d82afaf78a497395c3b4ba0b8294fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d82afaf78a497395c3b4ba0b8294fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d82afaf78a497395c3b4ba0b8294fd"}]}] Sep 05 12:19:06.269554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1146798112 Sep 05 12:19:06.269554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 09d82afaf78a497395c3b4ba0b8294fd Sep 05 12:19:06.269554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1146798112 Sep 05 12:19:06.269554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-VolumesSnapshotsTestJSON-1146798112-project Sep 05 12:19:06.269554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:19:06.269554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:19:06.269554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 02de21bffe154077866824e2033608fc Sep 05 12:19:06.269554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1146798112-project Sep 05 12:19:06.269554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: Sep 05 12:19:06.269554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:06.269554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7'} Sep 05 12:19:06.269554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. (HTTP 404) (Request-ID: req-fd989569-9e24-4580-82c7-0d9a6b462535) Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:19:06.270392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 12:19:06.271658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 05 12:19:06.272937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:19:06.274457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:06.274457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:06.274457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:19:06.274457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:06.274457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:06.274457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:19:06.274457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:19:06.274457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:19:06.274457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:19:06.274457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:06.274457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:06.276571 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-cb635f9e-ccde-4d58-a556-695a4fc671f4 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Returning 404 to user: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:19:06.278101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-cb635f9e-ccde-4d58-a556-695a4fc671f4 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7" status: 404 len: 109 microversion: 2.1 time: 0.105999 Sep 05 12:19:06.282260 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 29/51] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Sep 5 12:19:06 2022] DELETE /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:19:06.293516 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8dd95f48-ca56-41f9-a4f2-4eaa1078fd2d tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] Calling method '.version_select at 0x7fba4bdb11f0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:06.550579 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8dd95f48-ca56-41f9-a4f2-4eaa1078fd2d tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.266290 Sep 05 12:19:06.560765 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 30/52] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Sep 5 12:19:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:06.573937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8751a805-4119-472e-98a8-d6ecad371097 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Calling method '.version_select at 0x7fba4bd2c1f0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:06.661881 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-8751a805-4119-472e-98a8-d6ecad371097 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] HTTP exception thrown: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8751a805-4119-472e-98a8-d6ecad371097 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Request method failure captured: Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 HTTP/1.1 Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFekkZYk-Y3_Z-eQ1KWLU09kWbmqnYriqDA9t2HBV3QGjMddw2T5wQVN_N-WiErBiiBMU_C6xIxozMD3xAuk2qe5q_SjEU7yYASUAzL-lOVJTubH_djtakxqvcfI_3dMSrcom143iVBU9Mhv2rVf5Y8XUt-iNDyZxIBWiSFUDaDcp5dQ Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 09d82afaf78a497395c3b4ba0b8294fd Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1146798112 Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:19:06.664606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:19:06.665740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d82afaf78a497395c3b4ba0b8294fd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d82afaf78a497395c3b4ba0b8294fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d82afaf78a497395c3b4ba0b8294fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d82afaf78a497395c3b4ba0b8294fd"}]}] Sep 05 12:19:06.665740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1146798112 Sep 05 12:19:06.665740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 09d82afaf78a497395c3b4ba0b8294fd Sep 05 12:19:06.665740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1146798112 Sep 05 12:19:06.665740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-VolumesSnapshotsTestJSON-1146798112-project Sep 05 12:19:06.665740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:19:06.665740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:19:06.665740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 02de21bffe154077866824e2033608fc Sep 05 12:19:06.665740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1146798112-project Sep 05 12:19:06.665740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: Sep 05 12:19:06.665740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:06.665740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7'} Sep 05 12:19:06.665740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. (HTTP 404) (Request-ID: req-3315844f-e5bc-4307-af4a-9d6407219b31) Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:19:06.666485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:19:06.667464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 12:19:06.668423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:19:06.670766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:06.670766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:06.670766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:19:06.670766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:06.670766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:19:06.670766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:19:06.670766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:19:06.670766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:19:06.670766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:19:06.670766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. Sep 05 12:19:06.670766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:19:06.670766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8751a805-4119-472e-98a8-d6ecad371097 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] Returning 404 to user: Volume 4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:19:06.670766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8751a805-4119-472e-98a8-d6ecad371097 tempest-VolumesSnapshotsTestJSON-1146798112 tempest-VolumesSnapshotsTestJSON-1146798112-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7" status: 404 len: 109 microversion: 2.1 time: 0.101357 Sep 05 12:19:06.670766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 31/53] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Sep 5 12:19:06 2022] GET /compute/v2.1/os-volumes/4f4e21f5-b01c-4bec-ad9f-dbc65643c7f7 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:19:06.677374 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2fc15165-968e-4dfa-92cc-6cfa0f48a4c6 tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] Calling method '.version_select at 0x7fba4bd2cee0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:06.679174 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-48c70ad8-87b9-4be2-9380-d0a11d1b602a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Action: 'create', calling method: .version_select at 0x7fba4bde3a60>, body: {"keypair": {"name": "tempest-keypair-1922529357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+Cr2djDZxyNxubjbxwEmzfMblVHrKQrD+ZNPQ9tqdK27Y+b9OdLAXEnPf0k2z57Z5WBBSAi4CJkO9Q6ydPeNfeJR1Az6Vu3FRFPdyaY+OyH3BQ8jILako6dL/V7BJXPg=="}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:19:06.735503 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-48c70ad8-87b9-4be2-9380-d0a11d1b602a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Getting quotas for project 8f21d577dc6d44a7b05ee0a0232bed6c. Resources: {'key_pairs'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:19:06.753399 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-48c70ad8-87b9-4be2-9380-d0a11d1b602a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Getting quotas for user 45bd61574c6c4ebb9d6fe0c87228065f and project 8f21d577dc6d44a7b05ee0a0232bed6c. Resources: {'key_pairs'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:19:06.924252 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-48c70ad8-87b9-4be2-9380-d0a11d1b602a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.032413 Sep 05 12:19:06.925669 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 23/54] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Sep 5 12:19:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:06.953595 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1adadbe5-d3a3-4c67-8483-5e74290e8435 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:06.955399 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-1adadbe5-d3a3-4c67-8483-5e74290e8435 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:06.967136 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2fc15165-968e-4dfa-92cc-6cfa0f48a4c6 tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.298855 Sep 05 12:19:06.967851 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 32/55] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Sep 5 12:19:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:06.999719 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1599b3f3-62b7-4389-8b85-8a16ffd01081 tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] Calling method '.version_select at 0x7fba4bd22ee0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:07.031111 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1adadbe5-d3a3-4c67-8483-5e74290e8435 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:07.033949 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1adadbe5-d3a3-4c67-8483-5e74290e8435 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:07.037821 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1adadbe5-d3a3-4c67-8483-5e74290e8435 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:07.039168 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1adadbe5-d3a3-4c67-8483-5e74290e8435 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:07.040675 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1adadbe5-d3a3-4c67-8483-5e74290e8435 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:07.041155 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1adadbe5-d3a3-4c67-8483-5e74290e8435 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:07.300490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1599b3f3-62b7-4389-8b85-8a16ffd01081 tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.311970 Sep 05 12:19:07.318746 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 33/56] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Sep 5 12:19:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:07.377478 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2e4528e6-5fa1-49a4-9712-9309366dea6a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:07.381526 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2e4528e6-5fa1-49a4-9712-9309366dea6a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:07.725881 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2e4528e6-5fa1-49a4-9712-9309366dea6a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:07.755030 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2e4528e6-5fa1-49a4-9712-9309366dea6a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:07.767790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2e4528e6-5fa1-49a4-9712-9309366dea6a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:07.777819 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2e4528e6-5fa1-49a4-9712-9309366dea6a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1280 microversion: 2.20 time: 0.451443 Sep 05 12:19:07.802217 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 34/57] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:07 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1280 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:07.819140 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f12953e0-8f6c-4eb8-a4ed-5ee5c2d40d67 tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] Calling method '.version_select at 0x7fba4bd22280>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:08.019356 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1adadbe5-d3a3-4c67-8483-5e74290e8435 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:08.054763 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1adadbe5-d3a3-4c67-8483-5e74290e8435 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1285 microversion: 2.1 time: 1.112495 Sep 05 12:19:08.063619 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 24/58] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:06 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1285 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:08.105151 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f12953e0-8f6c-4eb8-a4ed-5ee5c2d40d67 tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.301235 Sep 05 12:19:08.105947 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 35/59] 10.222.0.16 () {58 vars in 1188 bytes} [Mon Sep 5 12:19:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:08.127014 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4331a620-e59e-4eb6-b432-a722ae1883ea tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] Calling method '.version_select at 0x7fba4bcc3dc0>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:08.385419 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4331a620-e59e-4eb6-b432-a722ae1883ea tempest-VolumesTestJSON-913450495 tempest-VolumesTestJSON-913450495-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.263440 Sep 05 12:19:08.386276 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 25/60] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Sep 5 12:19:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:08.810223 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e3c9d9cc-513d-4cac-a7ba-d5034a4304df tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:08.811744 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e3c9d9cc-513d-4cac-a7ba-d5034a4304df tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:08.826917 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e3c9d9cc-513d-4cac-a7ba-d5034a4304df tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:08.827450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e3c9d9cc-513d-4cac-a7ba-d5034a4304df tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:08.827930 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e3c9d9cc-513d-4cac-a7ba-d5034a4304df tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:08.831296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e3c9d9cc-513d-4cac-a7ba-d5034a4304df tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:08.832310 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e3c9d9cc-513d-4cac-a7ba-d5034a4304df tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:08.835277 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e3c9d9cc-513d-4cac-a7ba-d5034a4304df tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:09.085413 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6e88ccec-4f5a-4547-8eb7-2eba96f67a99 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:09.086493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6e88ccec-4f5a-4547-8eb7-2eba96f67a99 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:09.129099 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6e88ccec-4f5a-4547-8eb7-2eba96f67a99 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:09.141523 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6e88ccec-4f5a-4547-8eb7-2eba96f67a99 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:09.143298 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6e88ccec-4f5a-4547-8eb7-2eba96f67a99 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:09.148957 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6e88ccec-4f5a-4547-8eb7-2eba96f67a99 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:09.150371 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6e88ccec-4f5a-4547-8eb7-2eba96f67a99 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:09.155324 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6e88ccec-4f5a-4547-8eb7-2eba96f67a99 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:09.767007 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6e88ccec-4f5a-4547-8eb7-2eba96f67a99 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:09.821354 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6e88ccec-4f5a-4547-8eb7-2eba96f67a99 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1273 microversion: 2.1 time: 0.743722 Sep 05 12:19:09.831946 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 26/61] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:09 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1273 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:09.933616 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e3c9d9cc-513d-4cac-a7ba-d5034a4304df tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:09.954577 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e3c9d9cc-513d-4cac-a7ba-d5034a4304df tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:09.956633 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e3c9d9cc-513d-4cac-a7ba-d5034a4304df tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:09.969093 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e3c9d9cc-513d-4cac-a7ba-d5034a4304df tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1332 microversion: 2.20 time: 1.163318 Sep 05 12:19:09.969624 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 36/62] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:08 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1332 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:10.874151 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f20e01b4-1bb2-4b7a-bf07-f1b3117da08c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:10.879759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f20e01b4-1bb2-4b7a-bf07-f1b3117da08c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:10.943211 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f20e01b4-1bb2-4b7a-bf07-f1b3117da08c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:10.949924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f20e01b4-1bb2-4b7a-bf07-f1b3117da08c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:10.952252 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f20e01b4-1bb2-4b7a-bf07-f1b3117da08c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:10.955295 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f20e01b4-1bb2-4b7a-bf07-f1b3117da08c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:10.958183 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f20e01b4-1bb2-4b7a-bf07-f1b3117da08c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:10.958875 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f20e01b4-1bb2-4b7a-bf07-f1b3117da08c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:11.007633 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-eadc0834-3de6-430e-b96f-ec6caeb65a95 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:11.013520 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-eadc0834-3de6-430e-b96f-ec6caeb65a95 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:11.058476 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eadc0834-3de6-430e-b96f-ec6caeb65a95 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:11.059367 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eadc0834-3de6-430e-b96f-ec6caeb65a95 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:11.072488 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eadc0834-3de6-430e-b96f-ec6caeb65a95 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:11.073901 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eadc0834-3de6-430e-b96f-ec6caeb65a95 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:11.074694 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eadc0834-3de6-430e-b96f-ec6caeb65a95 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:11.075321 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eadc0834-3de6-430e-b96f-ec6caeb65a95 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:11.444091 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-eadc0834-3de6-430e-b96f-ec6caeb65a95 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:11.458837 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-eadc0834-3de6-430e-b96f-ec6caeb65a95 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:11.464032 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-eadc0834-3de6-430e-b96f-ec6caeb65a95 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:11.468510 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-eadc0834-3de6-430e-b96f-ec6caeb65a95 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1338 microversion: 2.20 time: 0.468685 Sep 05 12:19:11.476135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 37/63] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:10 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1338 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:12.528766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ad200788-3d70-4353-bdec-860b0e66cde4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:12.530211 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ad200788-3d70-4353-bdec-860b0e66cde4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:12.536201 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:12.569587 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ad200788-3d70-4353-bdec-860b0e66cde4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:12.574980 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ad200788-3d70-4353-bdec-860b0e66cde4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:12.577848 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ad200788-3d70-4353-bdec-860b0e66cde4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:12.589869 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ad200788-3d70-4353-bdec-860b0e66cde4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:12.596193 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ad200788-3d70-4353-bdec-860b0e66cde4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:12.596960 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ad200788-3d70-4353-bdec-860b0e66cde4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:12.998547 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ad200788-3d70-4353-bdec-860b0e66cde4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:13.051602 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ad200788-3d70-4353-bdec-860b0e66cde4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:13.058748 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ad200788-3d70-4353-bdec-860b0e66cde4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:13.066457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ad200788-3d70-4353-bdec-860b0e66cde4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1338 microversion: 2.20 time: 0.543759 Sep 05 12:19:13.070081 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 38/64] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:12 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1338 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:13.601365 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f20e01b4-1bb2-4b7a-bf07-f1b3117da08c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:13.619469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f20e01b4-1bb2-4b7a-bf07-f1b3117da08c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 2.773283 Sep 05 12:19:13.639562 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 27/65] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:10 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 2782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:14.125244 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-6a0fa780-9eab-4aca-a508-4f623b318d62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:14.135039 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-6a0fa780-9eab-4aca-a508-4f623b318d62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:14.172179 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6a0fa780-9eab-4aca-a508-4f623b318d62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:14.180317 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6a0fa780-9eab-4aca-a508-4f623b318d62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:14.183264 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6a0fa780-9eab-4aca-a508-4f623b318d62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:14.194603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6a0fa780-9eab-4aca-a508-4f623b318d62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:14.202609 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6a0fa780-9eab-4aca-a508-4f623b318d62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:14.214922 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6a0fa780-9eab-4aca-a508-4f623b318d62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:14.425348 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6a0fa780-9eab-4aca-a508-4f623b318d62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:14.442187 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6a0fa780-9eab-4aca-a508-4f623b318d62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:14.443715 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6a0fa780-9eab-4aca-a508-4f623b318d62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:14.454127 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-6a0fa780-9eab-4aca-a508-4f623b318d62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1338 microversion: 2.20 time: 0.345851 Sep 05 12:19:14.456378 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 39/66] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:14 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1338 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:14.653456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2819492e-cdce-4047-b93e-a4b3273fa6ff tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:14.655108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2819492e-cdce-4047-b93e-a4b3273fa6ff tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:14.674546 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2819492e-cdce-4047-b93e-a4b3273fa6ff tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:14.675064 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2819492e-cdce-4047-b93e-a4b3273fa6ff tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:14.675516 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2819492e-cdce-4047-b93e-a4b3273fa6ff tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:14.676293 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2819492e-cdce-4047-b93e-a4b3273fa6ff tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:14.676758 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2819492e-cdce-4047-b93e-a4b3273fa6ff tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:14.677199 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2819492e-cdce-4047-b93e-a4b3273fa6ff tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:15.367698 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:15.486562 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5fc39e36-9d2d-4ad3-8ebe-69d483e917a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:15.487277 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5fc39e36-9d2d-4ad3-8ebe-69d483e917a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:15.489287 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:15.511607 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5fc39e36-9d2d-4ad3-8ebe-69d483e917a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:15.512508 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5fc39e36-9d2d-4ad3-8ebe-69d483e917a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:15.513009 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5fc39e36-9d2d-4ad3-8ebe-69d483e917a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:15.517222 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5fc39e36-9d2d-4ad3-8ebe-69d483e917a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:15.518729 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5fc39e36-9d2d-4ad3-8ebe-69d483e917a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:15.519458 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5fc39e36-9d2d-4ad3-8ebe-69d483e917a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:15.703137 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5fc39e36-9d2d-4ad3-8ebe-69d483e917a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:15.714542 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5fc39e36-9d2d-4ad3-8ebe-69d483e917a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:15.725930 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5fc39e36-9d2d-4ad3-8ebe-69d483e917a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:15.727568 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5fc39e36-9d2d-4ad3-8ebe-69d483e917a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1338 microversion: 2.20 time: 0.247251 Sep 05 12:19:15.728813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 40/67] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:15 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1338 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:19:16.822294 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=10 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:16.999054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2819492e-cdce-4047-b93e-a4b3273fa6ff tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:17.025231 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2819492e-cdce-4047-b93e-a4b3273fa6ff tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 2.370987 Sep 05 12:19:17.029441 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 28/68] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:14 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 2382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:17.059818 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-edde5f03-8c7d-444a-8f92-3d4dfa3e9ce0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:17.076716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-edde5f03-8c7d-444a-8f92-3d4dfa3e9ce0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:17.093826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-edde5f03-8c7d-444a-8f92-3d4dfa3e9ce0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:17.094439 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-edde5f03-8c7d-444a-8f92-3d4dfa3e9ce0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:17.096311 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-edde5f03-8c7d-444a-8f92-3d4dfa3e9ce0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:17.098609 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-edde5f03-8c7d-444a-8f92-3d4dfa3e9ce0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:17.099158 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-edde5f03-8c7d-444a-8f92-3d4dfa3e9ce0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:17.101451 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-edde5f03-8c7d-444a-8f92-3d4dfa3e9ce0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:17.298943 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-9c6f1a89-9374-4324-8398-a34d224f9fb2 req-39cade6b-1171-4272-8a47-e44ec163c6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe593696-0213-453f-8fcb-ce9b0b0bcabd", "tag": "f78ef43d-1938-4202-a109-c89734c83e90"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:19:17.391091 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-9c6f1a89-9374-4324-8398-a34d224f9fb2 req-39cade6b-1171-4272-8a47-e44ec163c6d3 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:17.392038 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-9c6f1a89-9374-4324-8398-a34d224f9fb2 req-39cade6b-1171-4272-8a47-e44ec163c6d3 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:17.393845 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-9c6f1a89-9374-4324-8398-a34d224f9fb2 req-39cade6b-1171-4272-8a47-e44ec163c6d3 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:17.472307 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-9c6f1a89-9374-4324-8398-a34d224f9fb2 req-39cade6b-1171-4272-8a47-e44ec163c6d3 service nova] Creating event network-changed:f78ef43d-1938-4202-a109-c89734c83e90 for instance fe593696-0213-453f-8fcb-ce9b0b0bcabd on hv-cinder-85518 Sep 05 12:19:17.480942 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-9c6f1a89-9374-4324-8398-a34d224f9fb2 req-39cade6b-1171-4272-8a47-e44ec163c6d3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120534) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 05 12:19:17.481623 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-9c6f1a89-9374-4324-8398-a34d224f9fb2 req-39cade6b-1171-4272-8a47-e44ec163c6d3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120534) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 05 12:19:17.482928 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3a112f0c-1f1b-4694-a191-f1eb133292b0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:17.483391 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3a112f0c-1f1b-4694-a191-f1eb133292b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:17.483852 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3a112f0c-1f1b-4694-a191-f1eb133292b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:17.489067 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3a112f0c-1f1b-4694-a191-f1eb133292b0 None None] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:17.489904 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3a112f0c-1f1b-4694-a191-f1eb133292b0 None None] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:17.497422 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3a112f0c-1f1b-4694-a191-f1eb133292b0 None None] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:17.539868 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.compute.rpcapi [None req-3a112f0c-1f1b-4694-a191-f1eb133292b0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 05 12:19:17.541159 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3a112f0c-1f1b-4694-a191-f1eb133292b0 None None] Releasing lock "compute-rpcapi-router" {{(pid=120534) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 05 12:19:17.611807 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-3a112f0c-1f1b-4694-a191-f1eb133292b0 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.164123 Sep 05 12:19:17.612849 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 41/69] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:17.917822 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-664189332", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d576ead4-1f78-4a93-bce5-d3b879fdb32a"}], "security_groups": [{"name": "tempest-securitygroup--1374368687"}], "key_name": "tempest-keypair-1922529357", "user_data": "}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:19:17.967509 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=18 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:18.769677 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.network.neutron [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] validate_networks() for [('d576ead4-1f78-4a93-bce5-d3b879fdb32a', None, None, None, None, None)] {{(pid=120534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:19:19.828159 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-edde5f03-8c7d-444a-8f92-3d4dfa3e9ce0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:19.859292 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-edde5f03-8c7d-444a-8f92-3d4dfa3e9ce0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:19.866957 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-edde5f03-8c7d-444a-8f92-3d4dfa3e9ce0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:19.871545 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-edde5f03-8c7d-444a-8f92-3d4dfa3e9ce0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1406 microversion: 2.20 time: 2.838639 Sep 05 12:19:19.878198 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 29/70] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:17 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1406 bytes in 2845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:19.890256 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6af49f7f-bc4a-48da-b37c-c8aec4f5d7b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:19.897605 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6af49f7f-bc4a-48da-b37c-c8aec4f5d7b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:19.925343 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6af49f7f-bc4a-48da-b37c-c8aec4f5d7b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:19.927985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6af49f7f-bc4a-48da-b37c-c8aec4f5d7b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:19.929139 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6af49f7f-bc4a-48da-b37c-c8aec4f5d7b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:19.932178 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6af49f7f-bc4a-48da-b37c-c8aec4f5d7b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:19.933589 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6af49f7f-bc4a-48da-b37c-c8aec4f5d7b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:19.936349 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6af49f7f-bc4a-48da-b37c-c8aec4f5d7b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:20.802072 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Flavor limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:19:20.803878 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Image limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:19:20.806170 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Flavor pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:19:20.810765 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Image pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:19:20.811996 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:19:20.867406 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:20.868675 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:20.869999 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:20.881086 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:20.882604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:20.887225 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:21.010929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Getting quotas for project 8f21d577dc6d44a7b05ee0a0232bed6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:19:21.059445 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Getting quotas for user 45bd61574c6c4ebb9d6fe0c87228065f and project 8f21d577dc6d44a7b05ee0a0232bed6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:19:21.174409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Going to run 1 instances... {{(pid=120534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:19:21.188076 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:19:21.316708 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-dc40eab3-a39b-40f5-b5e4-842a24f011c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.405783 Sep 05 12:19:21.318216 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 42/71] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:19:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 3409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:19:21.373266 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-af63073a-d727-4763-a9dd-63793ae61ef4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:21.386213 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-af63073a-d727-4763-a9dd-63793ae61ef4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:21.440531 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af63073a-d727-4763-a9dd-63793ae61ef4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:21.454711 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af63073a-d727-4763-a9dd-63793ae61ef4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:21.458326 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af63073a-d727-4763-a9dd-63793ae61ef4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:21.469560 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af63073a-d727-4763-a9dd-63793ae61ef4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:21.476031 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af63073a-d727-4763-a9dd-63793ae61ef4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:21.484267 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af63073a-d727-4763-a9dd-63793ae61ef4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:21.526321 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6af49f7f-bc4a-48da-b37c-c8aec4f5d7b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:21.549574 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6af49f7f-bc4a-48da-b37c-c8aec4f5d7b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 1.666544 Sep 05 12:19:21.553400 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 30/72] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:19 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:21.576615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-fe7d8a6e-5c4e-40ae-b44c-3f559b187a25 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:21.583888 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-fe7d8a6e-5c4e-40ae-b44c-3f559b187a25 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:21.598998 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:21.977993 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-fe7d8a6e-5c4e-40ae-b44c-3f559b187a25 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:22.110728 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-fe7d8a6e-5c4e-40ae-b44c-3f559b187a25 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1237 microversion: 2.1 time: 0.550815 Sep 05 12:19:22.112178 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 31/73] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:21 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1237 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:22.560215 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-af63073a-d727-4763-a9dd-63793ae61ef4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:22.582215 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-af63073a-d727-4763-a9dd-63793ae61ef4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:22.585823 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-af63073a-d727-4763-a9dd-63793ae61ef4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:22.588450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-af63073a-d727-4763-a9dd-63793ae61ef4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1406 microversion: 2.20 time: 1.267862 Sep 05 12:19:22.592244 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 43/74] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:21 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1406 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:22.609753 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-bfd41665-7233-4bde-8b0e-952a70f3c030 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:22.630421 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-bfd41665-7233-4bde-8b0e-952a70f3c030 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:22.643900 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bfd41665-7233-4bde-8b0e-952a70f3c030 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:22.644777 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bfd41665-7233-4bde-8b0e-952a70f3c030 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:22.645550 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bfd41665-7233-4bde-8b0e-952a70f3c030 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:22.647564 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bfd41665-7233-4bde-8b0e-952a70f3c030 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:22.648387 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bfd41665-7233-4bde-8b0e-952a70f3c030 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:22.649388 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bfd41665-7233-4bde-8b0e-952a70f3c030 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:23.038134 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-bfd41665-7233-4bde-8b0e-952a70f3c030 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:23.058530 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-bfd41665-7233-4bde-8b0e-952a70f3c030 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 0.465148 Sep 05 12:19:23.065603 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 32/75] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:22 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:23.138629 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a8e31c30-d19c-471b-8143-cd324d32e0ab tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:23.139755 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a8e31c30-d19c-471b-8143-cd324d32e0ab tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:23.258985 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a8e31c30-d19c-471b-8143-cd324d32e0ab tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:23.268834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a8e31c30-d19c-471b-8143-cd324d32e0ab tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1237 microversion: 2.1 time: 0.134615 Sep 05 12:19:23.273776 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 44/76] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:23 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1237 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:23.636873 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-00a00546-86b8-4f52-82a3-535db655e3c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:23.637943 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-00a00546-86b8-4f52-82a3-535db655e3c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:23.648843 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00a00546-86b8-4f52-82a3-535db655e3c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:23.650960 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00a00546-86b8-4f52-82a3-535db655e3c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:23.651882 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00a00546-86b8-4f52-82a3-535db655e3c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:23.654051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00a00546-86b8-4f52-82a3-535db655e3c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:23.655264 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00a00546-86b8-4f52-82a3-535db655e3c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:23.656368 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00a00546-86b8-4f52-82a3-535db655e3c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:23.941744 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-00a00546-86b8-4f52-82a3-535db655e3c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:23.959443 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-00a00546-86b8-4f52-82a3-535db655e3c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:23.964092 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-00a00546-86b8-4f52-82a3-535db655e3c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:23.967197 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-00a00546-86b8-4f52-82a3-535db655e3c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1406 microversion: 2.20 time: 0.336749 Sep 05 12:19:23.968945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 45/77] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:23 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:19:24.004071 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-ab739ded-92e1-4718-b6c0-a20c18c25c59 req-f32f1664-6b1a-4c1f-8962-4f3096c8ce6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78cd9ae3-2a60-4905-a291-30169e41c86c", "tag": "6a5ea4f2-8220-4378-84c2-dc1b033a8dd0"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:19:24.031513 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-ab739ded-92e1-4718-b6c0-a20c18c25c59 req-f32f1664-6b1a-4c1f-8962-4f3096c8ce6c service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:24.033664 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-ab739ded-92e1-4718-b6c0-a20c18c25c59 req-f32f1664-6b1a-4c1f-8962-4f3096c8ce6c service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:24.034997 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-ab739ded-92e1-4718-b6c0-a20c18c25c59 req-f32f1664-6b1a-4c1f-8962-4f3096c8ce6c service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:24.080266 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-ab739ded-92e1-4718-b6c0-a20c18c25c59 req-f32f1664-6b1a-4c1f-8962-4f3096c8ce6c service nova] Creating event network-changed:6a5ea4f2-8220-4378-84c2-dc1b033a8dd0 for instance 78cd9ae3-2a60-4905-a291-30169e41c86c on hv-cinder-85518 Sep 05 12:19:24.081321 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-ab739ded-92e1-4718-b6c0-a20c18c25c59 req-f32f1664-6b1a-4c1f-8962-4f3096c8ce6c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 05 12:19:24.082083 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-ab739ded-92e1-4718-b6c0-a20c18c25c59 req-f32f1664-6b1a-4c1f-8962-4f3096c8ce6c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 05 12:19:24.085434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65fc8901-1ded-4431-808a-f3c2463ed167 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:24.086790 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65fc8901-1ded-4431-808a-f3c2463ed167 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:24.088155 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65fc8901-1ded-4431-808a-f3c2463ed167 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:24.089807 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65fc8901-1ded-4431-808a-f3c2463ed167 None None] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:24.091190 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65fc8901-1ded-4431-808a-f3c2463ed167 None None] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:24.092212 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65fc8901-1ded-4431-808a-f3c2463ed167 None None] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:24.103500 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1f800343-11c5-4b2f-bf0d-178a79692158 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:24.105557 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1f800343-11c5-4b2f-bf0d-178a79692158 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:24.116442 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.compute.rpcapi [None req-65fc8901-1ded-4431-808a-f3c2463ed167 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 05 12:19:24.124834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65fc8901-1ded-4431-808a-f3c2463ed167 None None] Releasing lock "compute-rpcapi-router" {{(pid=120535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 05 12:19:24.136579 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f800343-11c5-4b2f-bf0d-178a79692158 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:24.137365 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f800343-11c5-4b2f-bf0d-178a79692158 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:24.138292 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f800343-11c5-4b2f-bf0d-178a79692158 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:24.139478 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f800343-11c5-4b2f-bf0d-178a79692158 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:24.140656 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f800343-11c5-4b2f-bf0d-178a79692158 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:24.141116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f800343-11c5-4b2f-bf0d-178a79692158 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:24.179105 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-65fc8901-1ded-4431-808a-f3c2463ed167 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.820601 Sep 05 12:19:24.186164 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 33/78] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:24.302498 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b775cb03-03f5-4342-aa73-975b5e4c8721 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:24.303699 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b775cb03-03f5-4342-aa73-975b5e4c8721 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:24.316292 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b775cb03-03f5-4342-aa73-975b5e4c8721 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:24.318568 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b775cb03-03f5-4342-aa73-975b5e4c8721 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:24.320815 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b775cb03-03f5-4342-aa73-975b5e4c8721 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:24.322491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b775cb03-03f5-4342-aa73-975b5e4c8721 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:24.324228 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b775cb03-03f5-4342-aa73-975b5e4c8721 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:24.325742 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b775cb03-03f5-4342-aa73-975b5e4c8721 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:24.400090 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1f800343-11c5-4b2f-bf0d-178a79692158 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:24.412602 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1f800343-11c5-4b2f-bf0d-178a79692158 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 0.318444 Sep 05 12:19:24.413584 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 46/79] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:24 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:24.546006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b775cb03-03f5-4342-aa73-975b5e4c8721 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:24.556967 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b775cb03-03f5-4342-aa73-975b5e4c8721 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1241 microversion: 2.1 time: 0.262657 Sep 05 12:19:24.557651 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 34/80] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:24 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1241 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:25.014526 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d690fe41-1233-4ac6-8bda-eeb3a256395e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:25.016190 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d690fe41-1233-4ac6-8bda-eeb3a256395e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:25.028427 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d690fe41-1233-4ac6-8bda-eeb3a256395e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:25.029752 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d690fe41-1233-4ac6-8bda-eeb3a256395e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:25.031007 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d690fe41-1233-4ac6-8bda-eeb3a256395e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:25.032778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d690fe41-1233-4ac6-8bda-eeb3a256395e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:25.033556 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d690fe41-1233-4ac6-8bda-eeb3a256395e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:25.034794 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d690fe41-1233-4ac6-8bda-eeb3a256395e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:25.414362 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d690fe41-1233-4ac6-8bda-eeb3a256395e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:25.432602 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d690fe41-1233-4ac6-8bda-eeb3a256395e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:25.435999 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d690fe41-1233-4ac6-8bda-eeb3a256395e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:25.438229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d690fe41-1233-4ac6-8bda-eeb3a256395e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1406 microversion: 2.20 time: 0.430698 Sep 05 12:19:25.440199 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 47/81] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:25 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1406 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:19:25.467815 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2d958187-c793-4a8f-8372-c3b001a61706 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:25.468881 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2d958187-c793-4a8f-8372-c3b001a61706 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:25.489187 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d958187-c793-4a8f-8372-c3b001a61706 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:25.489982 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d958187-c793-4a8f-8372-c3b001a61706 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:25.490692 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d958187-c793-4a8f-8372-c3b001a61706 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:25.491922 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d958187-c793-4a8f-8372-c3b001a61706 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:25.492673 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d958187-c793-4a8f-8372-c3b001a61706 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:25.493391 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d958187-c793-4a8f-8372-c3b001a61706 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:25.608089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0e03acc7-b3f2-4689-a912-58b11491a300 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:25.608815 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0e03acc7-b3f2-4689-a912-58b11491a300 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:25.617047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0e03acc7-b3f2-4689-a912-58b11491a300 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:25.618193 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0e03acc7-b3f2-4689-a912-58b11491a300 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:25.618819 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0e03acc7-b3f2-4689-a912-58b11491a300 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:25.619941 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0e03acc7-b3f2-4689-a912-58b11491a300 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:25.620791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0e03acc7-b3f2-4689-a912-58b11491a300 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:25.621426 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0e03acc7-b3f2-4689-a912-58b11491a300 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:25.708275 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2d958187-c793-4a8f-8372-c3b001a61706 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:25.724084 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2d958187-c793-4a8f-8372-c3b001a61706 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 0.263699 Sep 05 12:19:25.725435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 35/82] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:25 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:19:25.743263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0e03acc7-b3f2-4689-a912-58b11491a300 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:25.751999 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0e03acc7-b3f2-4689-a912-58b11491a300 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1233 microversion: 2.1 time: 0.148249 Sep 05 12:19:25.752982 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 48/83] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:25 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1233 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:26.498650 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-26366eb4-38c1-4d1d-aa85-7a509c6f11ab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:26.500871 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-26366eb4-38c1-4d1d-aa85-7a509c6f11ab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:26.511447 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-26366eb4-38c1-4d1d-aa85-7a509c6f11ab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:26.512407 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-26366eb4-38c1-4d1d-aa85-7a509c6f11ab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:26.513474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-26366eb4-38c1-4d1d-aa85-7a509c6f11ab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:26.514473 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-26366eb4-38c1-4d1d-aa85-7a509c6f11ab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:26.515249 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-26366eb4-38c1-4d1d-aa85-7a509c6f11ab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:26.516036 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-26366eb4-38c1-4d1d-aa85-7a509c6f11ab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:26.722684 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-26366eb4-38c1-4d1d-aa85-7a509c6f11ab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:26.731587 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-26366eb4-38c1-4d1d-aa85-7a509c6f11ab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:26.733254 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-26366eb4-38c1-4d1d-aa85-7a509c6f11ab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:26.734680 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-26366eb4-38c1-4d1d-aa85-7a509c6f11ab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1406 microversion: 2.20 time: 0.243842 Sep 05 12:19:26.735331 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 36/84] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:26 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:26.762134 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d16e854e-a306-462b-88ea-df5c739bbd4c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:26.762938 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d16e854e-a306-462b-88ea-df5c739bbd4c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:26.770304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d16e854e-a306-462b-88ea-df5c739bbd4c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:26.770801 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d16e854e-a306-462b-88ea-df5c739bbd4c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:26.771245 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d16e854e-a306-462b-88ea-df5c739bbd4c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:26.772021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d16e854e-a306-462b-88ea-df5c739bbd4c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:26.772583 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d16e854e-a306-462b-88ea-df5c739bbd4c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:26.773191 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d16e854e-a306-462b-88ea-df5c739bbd4c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:26.778347 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=75 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:26.786486 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-bf34ea6b-5ee4-4971-9a22-7070c8b57890 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:26.787821 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-bf34ea6b-5ee4-4971-9a22-7070c8b57890 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:26.801641 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bf34ea6b-5ee4-4971-9a22-7070c8b57890 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:26.802590 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bf34ea6b-5ee4-4971-9a22-7070c8b57890 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:26.803672 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bf34ea6b-5ee4-4971-9a22-7070c8b57890 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:26.806001 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bf34ea6b-5ee4-4971-9a22-7070c8b57890 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:26.806933 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bf34ea6b-5ee4-4971-9a22-7070c8b57890 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:26.807900 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bf34ea6b-5ee4-4971-9a22-7070c8b57890 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:26.908027 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-bf34ea6b-5ee4-4971-9a22-7070c8b57890 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:26.929700 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-bf34ea6b-5ee4-4971-9a22-7070c8b57890 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1233 microversion: 2.1 time: 0.153254 Sep 05 12:19:26.953642 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 37/85] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:26 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1233 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:27.045340 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d16e854e-a306-462b-88ea-df5c739bbd4c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:27.062220 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d16e854e-a306-462b-88ea-df5c739bbd4c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 0.303661 Sep 05 12:19:27.063645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 49/86] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:26 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:27.763374 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b40e5522-2730-4310-9e13-ded7e1777201 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:27.764009 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b40e5522-2730-4310-9e13-ded7e1777201 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:27.775905 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b40e5522-2730-4310-9e13-ded7e1777201 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:27.776441 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b40e5522-2730-4310-9e13-ded7e1777201 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:27.776852 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b40e5522-2730-4310-9e13-ded7e1777201 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:27.777580 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b40e5522-2730-4310-9e13-ded7e1777201 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:27.778043 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b40e5522-2730-4310-9e13-ded7e1777201 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:27.778476 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b40e5522-2730-4310-9e13-ded7e1777201 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:27.966073 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ecdbff32-952d-40f9-b113-e76c7943bd4e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:27.966906 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ecdbff32-952d-40f9-b113-e76c7943bd4e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:27.975156 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ecdbff32-952d-40f9-b113-e76c7943bd4e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:27.975694 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ecdbff32-952d-40f9-b113-e76c7943bd4e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:27.976132 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ecdbff32-952d-40f9-b113-e76c7943bd4e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:27.976868 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ecdbff32-952d-40f9-b113-e76c7943bd4e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:27.977318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ecdbff32-952d-40f9-b113-e76c7943bd4e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:27.977752 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ecdbff32-952d-40f9-b113-e76c7943bd4e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:28.088101 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b40e5522-2730-4310-9e13-ded7e1777201 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:28.108897 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b40e5522-2730-4310-9e13-ded7e1777201 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:28.114481 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b40e5522-2730-4310-9e13-ded7e1777201 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:28.118739 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b40e5522-2730-4310-9e13-ded7e1777201 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1406 microversion: 2.20 time: 0.360089 Sep 05 12:19:28.120236 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 38/87] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:27 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1406 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:28.136330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c77505b7-45a6-469c-b475-a79aef513277 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:28.138156 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c77505b7-45a6-469c-b475-a79aef513277 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:28.156443 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c77505b7-45a6-469c-b475-a79aef513277 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:28.157053 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c77505b7-45a6-469c-b475-a79aef513277 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:28.157694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c77505b7-45a6-469c-b475-a79aef513277 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:28.158746 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c77505b7-45a6-469c-b475-a79aef513277 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:28.159244 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c77505b7-45a6-469c-b475-a79aef513277 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:28.159419 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ecdbff32-952d-40f9-b113-e76c7943bd4e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:28.160648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c77505b7-45a6-469c-b475-a79aef513277 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:28.186332 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ecdbff32-952d-40f9-b113-e76c7943bd4e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1289 microversion: 2.1 time: 0.223809 Sep 05 12:19:28.187350 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 50/88] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:27 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1289 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:28.746604 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c77505b7-45a6-469c-b475-a79aef513277 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:28.772528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c77505b7-45a6-469c-b475-a79aef513277 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 0.650855 Sep 05 12:19:28.776922 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 39/89] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:28 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:29.151983 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9f12cc63-36e2-4fc3-b353-13d264bc3d9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:29.153248 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9f12cc63-36e2-4fc3-b353-13d264bc3d9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:29.181427 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9f12cc63-36e2-4fc3-b353-13d264bc3d9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:29.182136 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9f12cc63-36e2-4fc3-b353-13d264bc3d9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:29.182603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9f12cc63-36e2-4fc3-b353-13d264bc3d9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:29.187021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9f12cc63-36e2-4fc3-b353-13d264bc3d9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:29.187914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9f12cc63-36e2-4fc3-b353-13d264bc3d9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:29.188721 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9f12cc63-36e2-4fc3-b353-13d264bc3d9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:29.218429 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b1783f19-9736-4b7f-a8db-f438c0d6ca09 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:29.220470 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b1783f19-9736-4b7f-a8db-f438c0d6ca09 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:29.256122 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1783f19-9736-4b7f-a8db-f438c0d6ca09 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:29.257129 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1783f19-9736-4b7f-a8db-f438c0d6ca09 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:29.257899 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1783f19-9736-4b7f-a8db-f438c0d6ca09 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:29.259303 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1783f19-9736-4b7f-a8db-f438c0d6ca09 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:29.260254 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1783f19-9736-4b7f-a8db-f438c0d6ca09 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:29.260940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1783f19-9736-4b7f-a8db-f438c0d6ca09 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:29.458779 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b1783f19-9736-4b7f-a8db-f438c0d6ca09 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:29.479932 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b1783f19-9736-4b7f-a8db-f438c0d6ca09 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1295 microversion: 2.1 time: 0.268740 Sep 05 12:19:29.480897 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 40/90] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:29 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1295 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:29.693012 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9f12cc63-36e2-4fc3-b353-13d264bc3d9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:29.728747 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9f12cc63-36e2-4fc3-b353-13d264bc3d9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:29.731671 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9f12cc63-36e2-4fc3-b353-13d264bc3d9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:29.741643 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9f12cc63-36e2-4fc3-b353-13d264bc3d9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1406 microversion: 2.20 time: 0.597374 Sep 05 12:19:29.751849 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 51/91] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:29 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1406 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:19:29.802881 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e25aabae-7859-44a6-9377-f04d48126579 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:29.805195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e25aabae-7859-44a6-9377-f04d48126579 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:29.828793 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e25aabae-7859-44a6-9377-f04d48126579 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:29.830806 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e25aabae-7859-44a6-9377-f04d48126579 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:29.837407 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e25aabae-7859-44a6-9377-f04d48126579 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:29.839249 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e25aabae-7859-44a6-9377-f04d48126579 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:29.840506 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e25aabae-7859-44a6-9377-f04d48126579 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:29.841563 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e25aabae-7859-44a6-9377-f04d48126579 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:30.325646 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e25aabae-7859-44a6-9377-f04d48126579 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:30.342972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e25aabae-7859-44a6-9377-f04d48126579 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 0.546798 Sep 05 12:19:30.344624 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 41/92] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:29 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:30.538176 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e02569a4-4a5a-40a6-8049-d4405dff3e35 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:30.545537 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e02569a4-4a5a-40a6-8049-d4405dff3e35 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:30.571039 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e02569a4-4a5a-40a6-8049-d4405dff3e35 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:30.576213 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e02569a4-4a5a-40a6-8049-d4405dff3e35 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:30.577486 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e02569a4-4a5a-40a6-8049-d4405dff3e35 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:30.580314 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e02569a4-4a5a-40a6-8049-d4405dff3e35 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:30.584393 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e02569a4-4a5a-40a6-8049-d4405dff3e35 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:30.585616 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e02569a4-4a5a-40a6-8049-d4405dff3e35 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:30.794767 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2603d31a-91dd-4ff9-897d-0ed6f1c0f171 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:30.795409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2603d31a-91dd-4ff9-897d-0ed6f1c0f171 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:30.808651 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2603d31a-91dd-4ff9-897d-0ed6f1c0f171 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:30.809688 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2603d31a-91dd-4ff9-897d-0ed6f1c0f171 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:30.809688 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2603d31a-91dd-4ff9-897d-0ed6f1c0f171 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:30.810262 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2603d31a-91dd-4ff9-897d-0ed6f1c0f171 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:30.810712 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2603d31a-91dd-4ff9-897d-0ed6f1c0f171 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:30.811140 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2603d31a-91dd-4ff9-897d-0ed6f1c0f171 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:30.878198 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=100 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:30.962959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=4 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:31.150293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e02569a4-4a5a-40a6-8049-d4405dff3e35 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:31.165666 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e02569a4-4a5a-40a6-8049-d4405dff3e35 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1363 microversion: 2.1 time: 0.635761 Sep 05 12:19:31.166326 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 52/93] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:30 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1363 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:31.379322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1acf8561-1e31-4c49-a6a9-6f737f9c1451 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:31.380603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1acf8561-1e31-4c49-a6a9-6f737f9c1451 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:31.416397 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2603d31a-91dd-4ff9-897d-0ed6f1c0f171 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:31.434077 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1acf8561-1e31-4c49-a6a9-6f737f9c1451 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:31.434911 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1acf8561-1e31-4c49-a6a9-6f737f9c1451 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:31.441515 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1acf8561-1e31-4c49-a6a9-6f737f9c1451 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:31.442902 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1acf8561-1e31-4c49-a6a9-6f737f9c1451 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:31.450349 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1acf8561-1e31-4c49-a6a9-6f737f9c1451 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:31.451194 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1acf8561-1e31-4c49-a6a9-6f737f9c1451 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:31.461625 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2603d31a-91dd-4ff9-897d-0ed6f1c0f171 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:31.463453 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2603d31a-91dd-4ff9-897d-0ed6f1c0f171 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:31.464897 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2603d31a-91dd-4ff9-897d-0ed6f1c0f171 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1406 microversion: 2.20 time: 0.673990 Sep 05 12:19:31.476467 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 42/94] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:30 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1406 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:32.213671 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a76957dc-2b71-4690-a91e-e3e4f75c77ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:32.215126 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a76957dc-2b71-4690-a91e-e3e4f75c77ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:32.230240 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:32.233878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a76957dc-2b71-4690-a91e-e3e4f75c77ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:32.236736 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a76957dc-2b71-4690-a91e-e3e4f75c77ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:32.237374 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a76957dc-2b71-4690-a91e-e3e4f75c77ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:32.240730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a76957dc-2b71-4690-a91e-e3e4f75c77ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:32.248782 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a76957dc-2b71-4690-a91e-e3e4f75c77ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:32.252541 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a76957dc-2b71-4690-a91e-e3e4f75c77ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:32.414558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1acf8561-1e31-4c49-a6a9-6f737f9c1451 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:32.429632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1acf8561-1e31-4c49-a6a9-6f737f9c1451 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 1.065980 Sep 05 12:19:32.430760 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 53/95] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:31 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:19:32.493949 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0fb734c2-b54a-4e3b-9840-333dd2a7c52a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:32.495015 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0fb734c2-b54a-4e3b-9840-333dd2a7c52a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:32.506475 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0fb734c2-b54a-4e3b-9840-333dd2a7c52a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:32.507371 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0fb734c2-b54a-4e3b-9840-333dd2a7c52a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:32.508295 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0fb734c2-b54a-4e3b-9840-333dd2a7c52a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:32.509407 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0fb734c2-b54a-4e3b-9840-333dd2a7c52a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:32.510027 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0fb734c2-b54a-4e3b-9840-333dd2a7c52a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:32.510794 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0fb734c2-b54a-4e3b-9840-333dd2a7c52a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:32.960411 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a76957dc-2b71-4690-a91e-e3e4f75c77ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:32.985061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a76957dc-2b71-4690-a91e-e3e4f75c77ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1363 microversion: 2.1 time: 0.774713 Sep 05 12:19:32.991556 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 43/96] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:32 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1363 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:19:33.173768 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0fb734c2-b54a-4e3b-9840-333dd2a7c52a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:33.201024 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0fb734c2-b54a-4e3b-9840-333dd2a7c52a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:33.209906 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0fb734c2-b54a-4e3b-9840-333dd2a7c52a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:33.213716 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0fb734c2-b54a-4e3b-9840-333dd2a7c52a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1406 microversion: 2.20 time: 0.724213 Sep 05 12:19:33.215132 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 54/97] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:32 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1406 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:33.282849 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-edfdd60b-5989-409f-b4f7-373caaaafd8b req-24d58903-15b5-4ef8-a815-349393bafec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe593696-0213-453f-8fcb-ce9b0b0bcabd", "name": "network-vif-plugged", "status": "completed", "tag": "f78ef43d-1938-4202-a109-c89734c83e90"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:19:33.304616 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-edfdd60b-5989-409f-b4f7-373caaaafd8b req-24d58903-15b5-4ef8-a815-349393bafec0 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:33.305083 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-edfdd60b-5989-409f-b4f7-373caaaafd8b req-24d58903-15b5-4ef8-a815-349393bafec0 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:33.305514 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-edfdd60b-5989-409f-b4f7-373caaaafd8b req-24d58903-15b5-4ef8-a815-349393bafec0 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:33.330177 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-edfdd60b-5989-409f-b4f7-373caaaafd8b req-24d58903-15b5-4ef8-a815-349393bafec0 service nova] Creating event network-vif-plugged:f78ef43d-1938-4202-a109-c89734c83e90 for instance fe593696-0213-453f-8fcb-ce9b0b0bcabd on hv-cinder-85518 Sep 05 12:19:33.345113 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-edfdd60b-5989-409f-b4f7-373caaaafd8b req-24d58903-15b5-4ef8-a815-349393bafec0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275019 Sep 05 12:19:33.351123 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 44/98] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:19:33.456509 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f4f91a0c-e5f9-40c5-bd09-411077b1bf68 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:33.458085 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f4f91a0c-e5f9-40c5-bd09-411077b1bf68 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:33.466695 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=8 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:33.469530 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f4f91a0c-e5f9-40c5-bd09-411077b1bf68 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:33.470617 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f4f91a0c-e5f9-40c5-bd09-411077b1bf68 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:33.471275 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f4f91a0c-e5f9-40c5-bd09-411077b1bf68 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:33.472208 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f4f91a0c-e5f9-40c5-bd09-411077b1bf68 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:33.473435 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f4f91a0c-e5f9-40c5-bd09-411077b1bf68 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:33.474040 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f4f91a0c-e5f9-40c5-bd09-411077b1bf68 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:33.787098 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-d814d4fa-c37f-46ef-a606-93dc0609145f req-c7f9a3a1-04ac-4a12-a7d2-c19c196d8bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b78eb7b3-fb70-404b-b598-c80dd26f2827", "tag": "c7568900-c23a-4731-a0b3-57f3e306773b"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:19:33.814797 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-d814d4fa-c37f-46ef-a606-93dc0609145f req-c7f9a3a1-04ac-4a12-a7d2-c19c196d8bbf service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:33.816243 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-d814d4fa-c37f-46ef-a606-93dc0609145f req-c7f9a3a1-04ac-4a12-a7d2-c19c196d8bbf service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:33.818562 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-d814d4fa-c37f-46ef-a606-93dc0609145f req-c7f9a3a1-04ac-4a12-a7d2-c19c196d8bbf service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:33.843644 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-d814d4fa-c37f-46ef-a606-93dc0609145f req-c7f9a3a1-04ac-4a12-a7d2-c19c196d8bbf service nova] Creating event network-changed:c7568900-c23a-4731-a0b3-57f3e306773b for instance b78eb7b3-fb70-404b-b598-c80dd26f2827 on hv-cinder-85518 Sep 05 12:19:33.850192 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-d814d4fa-c37f-46ef-a606-93dc0609145f req-c7f9a3a1-04ac-4a12-a7d2-c19c196d8bbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070185 Sep 05 12:19:33.851471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 45/99] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:34.057603 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f2deda6b-2f15-4134-8462-6cd9fa8c444b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:34.058303 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f2deda6b-2f15-4134-8462-6cd9fa8c444b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:34.069551 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f2deda6b-2f15-4134-8462-6cd9fa8c444b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:34.071313 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f2deda6b-2f15-4134-8462-6cd9fa8c444b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:34.072041 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f2deda6b-2f15-4134-8462-6cd9fa8c444b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:34.073153 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f2deda6b-2f15-4134-8462-6cd9fa8c444b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:34.074075 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f2deda6b-2f15-4134-8462-6cd9fa8c444b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:34.074698 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f2deda6b-2f15-4134-8462-6cd9fa8c444b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:34.077153 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f4f91a0c-e5f9-40c5-bd09-411077b1bf68 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:34.112484 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f4f91a0c-e5f9-40c5-bd09-411077b1bf68 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 0.662070 Sep 05 12:19:34.113708 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:34.120783 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 55/100] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:33 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:34.249198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4679af0a-4e08-4e4b-b75f-35892e662cf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:34.252715 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4679af0a-4e08-4e4b-b75f-35892e662cf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:34.285336 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4679af0a-4e08-4e4b-b75f-35892e662cf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:34.289554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4679af0a-4e08-4e4b-b75f-35892e662cf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:34.291246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4679af0a-4e08-4e4b-b75f-35892e662cf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:34.293759 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4679af0a-4e08-4e4b-b75f-35892e662cf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:34.296441 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4679af0a-4e08-4e4b-b75f-35892e662cf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:34.298147 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4679af0a-4e08-4e4b-b75f-35892e662cf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:34.358446 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f2deda6b-2f15-4134-8462-6cd9fa8c444b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:34.371428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f2deda6b-2f15-4134-8462-6cd9fa8c444b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1363 microversion: 2.1 time: 0.317942 Sep 05 12:19:34.389984 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 46/101] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:34 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:34.686454 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4679af0a-4e08-4e4b-b75f-35892e662cf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:34.717869 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4679af0a-4e08-4e4b-b75f-35892e662cf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:34.723847 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4679af0a-4e08-4e4b-b75f-35892e662cf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:34.726389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4679af0a-4e08-4e4b-b75f-35892e662cf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1406 microversion: 2.20 time: 0.487103 Sep 05 12:19:34.741774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 56/102] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:34 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1406 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:19:35.152955 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4f858311-579d-4c7c-8b7b-3bf3c5083bf4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:35.153664 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4f858311-579d-4c7c-8b7b-3bf3c5083bf4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:35.170017 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f858311-579d-4c7c-8b7b-3bf3c5083bf4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:35.170513 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f858311-579d-4c7c-8b7b-3bf3c5083bf4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:35.174171 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f858311-579d-4c7c-8b7b-3bf3c5083bf4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:35.174998 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f858311-579d-4c7c-8b7b-3bf3c5083bf4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:35.175476 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f858311-579d-4c7c-8b7b-3bf3c5083bf4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:35.175986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f858311-579d-4c7c-8b7b-3bf3c5083bf4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:35.413221 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-70e9bd07-975b-4fa7-a74b-3374d3e22546 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:35.415855 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-70e9bd07-975b-4fa7-a74b-3374d3e22546 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:35.431761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-70e9bd07-975b-4fa7-a74b-3374d3e22546 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:35.432914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-70e9bd07-975b-4fa7-a74b-3374d3e22546 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:35.433695 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-70e9bd07-975b-4fa7-a74b-3374d3e22546 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:35.435365 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-70e9bd07-975b-4fa7-a74b-3374d3e22546 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:35.436438 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-70e9bd07-975b-4fa7-a74b-3374d3e22546 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:35.437209 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-70e9bd07-975b-4fa7-a74b-3374d3e22546 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:35.451321 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4f858311-579d-4c7c-8b7b-3bf3c5083bf4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:35.474636 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4f858311-579d-4c7c-8b7b-3bf3c5083bf4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 0.326010 Sep 05 12:19:35.475502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 47/103] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:35 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:35.774982 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a80f8e13-42d1-4c9c-a24a-2e575ae747ba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:35.775868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a80f8e13-42d1-4c9c-a24a-2e575ae747ba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:35.786636 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a80f8e13-42d1-4c9c-a24a-2e575ae747ba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:35.787448 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a80f8e13-42d1-4c9c-a24a-2e575ae747ba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:35.788157 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a80f8e13-42d1-4c9c-a24a-2e575ae747ba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:35.789277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a80f8e13-42d1-4c9c-a24a-2e575ae747ba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:35.790022 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a80f8e13-42d1-4c9c-a24a-2e575ae747ba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:35.790671 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a80f8e13-42d1-4c9c-a24a-2e575ae747ba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:36.089588 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-70e9bd07-975b-4fa7-a74b-3374d3e22546 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:36.143997 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-70e9bd07-975b-4fa7-a74b-3374d3e22546 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1363 microversion: 2.1 time: 0.741377 Sep 05 12:19:36.150288 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 57/104] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:35 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1363 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:36.179104 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a80f8e13-42d1-4c9c-a24a-2e575ae747ba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:36.242891 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a80f8e13-42d1-4c9c-a24a-2e575ae747ba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:36.252553 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a80f8e13-42d1-4c9c-a24a-2e575ae747ba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:36.260315 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a80f8e13-42d1-4c9c-a24a-2e575ae747ba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1406 microversion: 2.20 time: 0.483809 Sep 05 12:19:36.263436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 48/105] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:35 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1406 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:36.528695 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-cdb848b7-ff74-4297-aa18-e2a21e2c2930 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:36.531946 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-cdb848b7-ff74-4297-aa18-e2a21e2c2930 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:36.552521 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cdb848b7-ff74-4297-aa18-e2a21e2c2930 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:36.554031 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cdb848b7-ff74-4297-aa18-e2a21e2c2930 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:36.556298 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cdb848b7-ff74-4297-aa18-e2a21e2c2930 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:36.562079 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cdb848b7-ff74-4297-aa18-e2a21e2c2930 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:36.564395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cdb848b7-ff74-4297-aa18-e2a21e2c2930 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:36.566221 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cdb848b7-ff74-4297-aa18-e2a21e2c2930 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:36.575172 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-f4f4fa65-1480-4a2e-a1fd-aa230f529556 req-08fed251-2d05-4802-9f6b-726571e6555c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78cd9ae3-2a60-4905-a291-30169e41c86c", "name": "network-vif-plugged", "status": "completed", "tag": "6a5ea4f2-8220-4378-84c2-dc1b033a8dd0"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:19:36.597079 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-f4f4fa65-1480-4a2e-a1fd-aa230f529556 req-08fed251-2d05-4802-9f6b-726571e6555c service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:36.597562 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-f4f4fa65-1480-4a2e-a1fd-aa230f529556 req-08fed251-2d05-4802-9f6b-726571e6555c service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:36.597995 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-f4f4fa65-1480-4a2e-a1fd-aa230f529556 req-08fed251-2d05-4802-9f6b-726571e6555c service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:36.635034 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-f4f4fa65-1480-4a2e-a1fd-aa230f529556 req-08fed251-2d05-4802-9f6b-726571e6555c service nova] Creating event network-vif-plugged:6a5ea4f2-8220-4378-84c2-dc1b033a8dd0 for instance 78cd9ae3-2a60-4905-a291-30169e41c86c on hv-cinder-85518 Sep 05 12:19:36.656050 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-f4f4fa65-1480-4a2e-a1fd-aa230f529556 req-08fed251-2d05-4802-9f6b-726571e6555c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084662 Sep 05 12:19:36.657819 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 49/106] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:19:36.958108 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-cdb848b7-ff74-4297-aa18-e2a21e2c2930 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:36.978532 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-cdb848b7-ff74-4297-aa18-e2a21e2c2930 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 0.462486 Sep 05 12:19:36.980111 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 58/107] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:36 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:37.180671 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f566372b-079b-4fba-a617-014bd9f2c01d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:37.182450 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f566372b-079b-4fba-a617-014bd9f2c01d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:37.194934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f566372b-079b-4fba-a617-014bd9f2c01d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:37.195910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f566372b-079b-4fba-a617-014bd9f2c01d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:37.197080 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f566372b-079b-4fba-a617-014bd9f2c01d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:37.198359 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f566372b-079b-4fba-a617-014bd9f2c01d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:37.212870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f566372b-079b-4fba-a617-014bd9f2c01d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:37.214138 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f566372b-079b-4fba-a617-014bd9f2c01d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:37.290516 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-efa73c77-84dd-4d4e-83a4-1f66bada6939 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:37.292972 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-efa73c77-84dd-4d4e-83a4-1f66bada6939 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:37.303467 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-efa73c77-84dd-4d4e-83a4-1f66bada6939 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:37.304277 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-efa73c77-84dd-4d4e-83a4-1f66bada6939 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:37.305029 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-efa73c77-84dd-4d4e-83a4-1f66bada6939 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:37.306183 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-efa73c77-84dd-4d4e-83a4-1f66bada6939 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:37.306981 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-efa73c77-84dd-4d4e-83a4-1f66bada6939 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:37.307603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-efa73c77-84dd-4d4e-83a4-1f66bada6939 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:37.548508 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-efa73c77-84dd-4d4e-83a4-1f66bada6939 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:37.549157 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f566372b-079b-4fba-a617-014bd9f2c01d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:37.560216 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f566372b-079b-4fba-a617-014bd9f2c01d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1363 microversion: 2.1 time: 0.387968 Sep 05 12:19:37.561494 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 50/108] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:37 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1363 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:37.568316 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-efa73c77-84dd-4d4e-83a4-1f66bada6939 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:37.572094 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-efa73c77-84dd-4d4e-83a4-1f66bada6939 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:37.574465 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-efa73c77-84dd-4d4e-83a4-1f66bada6939 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1406 microversion: 2.20 time: 0.288117 Sep 05 12:19:37.576790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 59/109] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:37 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:38.005651 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-852f7f96-7b79-495e-b25f-666758085ef5 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:38.006429 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-852f7f96-7b79-495e-b25f-666758085ef5 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:38.013183 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-852f7f96-7b79-495e-b25f-666758085ef5 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:38.013852 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-852f7f96-7b79-495e-b25f-666758085ef5 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:38.014531 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-852f7f96-7b79-495e-b25f-666758085ef5 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:38.015449 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-852f7f96-7b79-495e-b25f-666758085ef5 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:38.015954 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-852f7f96-7b79-495e-b25f-666758085ef5 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:38.016371 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-852f7f96-7b79-495e-b25f-666758085ef5 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:38.347330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-852f7f96-7b79-495e-b25f-666758085ef5 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:38.361992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-852f7f96-7b79-495e-b25f-666758085ef5 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 0.360461 Sep 05 12:19:38.367040 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 51/110] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:37 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:19:38.607894 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-6bbd0f3a-5bb3-4041-bf71-cd1d7e9f891b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:38.609766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-6bbd0f3a-5bb3-4041-bf71-cd1d7e9f891b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:38.623609 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-eb37914b-9369-4065-a4d8-7c13f5d4b7c4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:38.624762 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-eb37914b-9369-4065-a4d8-7c13f5d4b7c4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:38.636978 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eb37914b-9369-4065-a4d8-7c13f5d4b7c4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:38.638926 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6bbd0f3a-5bb3-4041-bf71-cd1d7e9f891b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:38.640119 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6bbd0f3a-5bb3-4041-bf71-cd1d7e9f891b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:38.640912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eb37914b-9369-4065-a4d8-7c13f5d4b7c4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:38.641960 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6bbd0f3a-5bb3-4041-bf71-cd1d7e9f891b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:38.642578 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eb37914b-9369-4065-a4d8-7c13f5d4b7c4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:38.643406 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eb37914b-9369-4065-a4d8-7c13f5d4b7c4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:38.644498 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6bbd0f3a-5bb3-4041-bf71-cd1d7e9f891b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:38.645380 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eb37914b-9369-4065-a4d8-7c13f5d4b7c4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:38.645380 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eb37914b-9369-4065-a4d8-7c13f5d4b7c4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:38.646272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6bbd0f3a-5bb3-4041-bf71-cd1d7e9f891b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:38.647898 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6bbd0f3a-5bb3-4041-bf71-cd1d7e9f891b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:39.005877 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-eb37914b-9369-4065-a4d8-7c13f5d4b7c4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:39.010978 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6bbd0f3a-5bb3-4041-bf71-cd1d7e9f891b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:39.024769 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-6bbd0f3a-5bb3-4041-bf71-cd1d7e9f891b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1363 microversion: 2.1 time: 0.422981 Sep 05 12:19:39.030832 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-eb37914b-9369-4065-a4d8-7c13f5d4b7c4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:39.036399 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-eb37914b-9369-4065-a4d8-7c13f5d4b7c4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:39.040033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-eb37914b-9369-4065-a4d8-7c13f5d4b7c4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1406 microversion: 2.20 time: 0.421553 Sep 05 12:19:39.040310 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 60/111] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:38 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:39.041815 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 52/112] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:38 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:19:39.408442 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-83ef3305-a08d-43f5-bcd7-e239a951055f tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:39.419716 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-83ef3305-a08d-43f5-bcd7-e239a951055f tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:39.446920 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-83ef3305-a08d-43f5-bcd7-e239a951055f tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:39.450967 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-83ef3305-a08d-43f5-bcd7-e239a951055f tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:39.452067 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-83ef3305-a08d-43f5-bcd7-e239a951055f tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:39.458547 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-83ef3305-a08d-43f5-bcd7-e239a951055f tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:39.459563 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-83ef3305-a08d-43f5-bcd7-e239a951055f tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:39.460613 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-83ef3305-a08d-43f5-bcd7-e239a951055f tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:39.823884 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-83ef3305-a08d-43f5-bcd7-e239a951055f tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:39.832337 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-83ef3305-a08d-43f5-bcd7-e239a951055f tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1315 microversion: 2.1 time: 0.442558 Sep 05 12:19:39.833248 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 61/113] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:39 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:19:40.051133 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-36fc009d-bc7b-409c-8e73-b1181ece7254 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:40.052294 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-36fc009d-bc7b-409c-8e73-b1181ece7254 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:40.068504 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1585a7e5-bcc4-40dd-9795-4ca2e4324a29 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:40.069182 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1585a7e5-bcc4-40dd-9795-4ca2e4324a29 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:40.084707 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-36fc009d-bc7b-409c-8e73-b1181ece7254 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:40.085213 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-36fc009d-bc7b-409c-8e73-b1181ece7254 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:40.085628 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-36fc009d-bc7b-409c-8e73-b1181ece7254 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:40.100719 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1585a7e5-bcc4-40dd-9795-4ca2e4324a29 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:40.101279 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1585a7e5-bcc4-40dd-9795-4ca2e4324a29 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:40.101778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-36fc009d-bc7b-409c-8e73-b1181ece7254 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:40.102444 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-36fc009d-bc7b-409c-8e73-b1181ece7254 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:40.103157 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-36fc009d-bc7b-409c-8e73-b1181ece7254 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:40.105292 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1585a7e5-bcc4-40dd-9795-4ca2e4324a29 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:40.106051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1585a7e5-bcc4-40dd-9795-4ca2e4324a29 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:40.115378 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1585a7e5-bcc4-40dd-9795-4ca2e4324a29 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:40.115958 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1585a7e5-bcc4-40dd-9795-4ca2e4324a29 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:40.497913 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1585a7e5-bcc4-40dd-9795-4ca2e4324a29 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:40.511587 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1585a7e5-bcc4-40dd-9795-4ca2e4324a29 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:40.514146 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1585a7e5-bcc4-40dd-9795-4ca2e4324a29 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:40.517140 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1585a7e5-bcc4-40dd-9795-4ca2e4324a29 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1406 microversion: 2.20 time: 0.452256 Sep 05 12:19:40.518167 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 62/114] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:40 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1406 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:19:40.530276 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-36fc009d-bc7b-409c-8e73-b1181ece7254 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:40.549933 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-36fc009d-bc7b-409c-8e73-b1181ece7254 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1363 microversion: 2.1 time: 0.503237 Sep 05 12:19:40.551654 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 53/115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:40 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1363 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:19:40.858189 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-62f8ecc0-0659-4ac6-9a0d-b0095da1b0c0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:40.858859 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-62f8ecc0-0659-4ac6-9a0d-b0095da1b0c0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:40.867101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-62f8ecc0-0659-4ac6-9a0d-b0095da1b0c0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:40.867660 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-62f8ecc0-0659-4ac6-9a0d-b0095da1b0c0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:40.869067 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-62f8ecc0-0659-4ac6-9a0d-b0095da1b0c0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:40.871709 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-62f8ecc0-0659-4ac6-9a0d-b0095da1b0c0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:40.872282 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-62f8ecc0-0659-4ac6-9a0d-b0095da1b0c0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:40.872771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-62f8ecc0-0659-4ac6-9a0d-b0095da1b0c0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:41.136818 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-62f8ecc0-0659-4ac6-9a0d-b0095da1b0c0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:41.150776 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-62f8ecc0-0659-4ac6-9a0d-b0095da1b0c0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1503 microversion: 2.1 time: 0.296858 Sep 05 12:19:41.151836 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 63/116] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:40 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:19:41.547961 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6f5624e7-9583-4fa9-8b18-45b38f65b626 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:41.548760 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6f5624e7-9583-4fa9-8b18-45b38f65b626 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:41.564028 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f5624e7-9583-4fa9-8b18-45b38f65b626 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:41.564323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f5624e7-9583-4fa9-8b18-45b38f65b626 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:41.564623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f5624e7-9583-4fa9-8b18-45b38f65b626 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:41.565345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f5624e7-9583-4fa9-8b18-45b38f65b626 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:41.565801 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f5624e7-9583-4fa9-8b18-45b38f65b626 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:41.566320 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f5624e7-9583-4fa9-8b18-45b38f65b626 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:41.574435 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a2191a85-1cba-422e-8107-fcfe43f76bb6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:41.575458 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a2191a85-1cba-422e-8107-fcfe43f76bb6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:41.590340 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2191a85-1cba-422e-8107-fcfe43f76bb6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:41.590945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2191a85-1cba-422e-8107-fcfe43f76bb6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:41.591400 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2191a85-1cba-422e-8107-fcfe43f76bb6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:41.592876 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2191a85-1cba-422e-8107-fcfe43f76bb6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:41.593342 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2191a85-1cba-422e-8107-fcfe43f76bb6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:41.596536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2191a85-1cba-422e-8107-fcfe43f76bb6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:42.099783 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6f5624e7-9583-4fa9-8b18-45b38f65b626 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:42.109221 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6f5624e7-9583-4fa9-8b18-45b38f65b626 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:42.121555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6f5624e7-9583-4fa9-8b18-45b38f65b626 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:42.128242 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6f5624e7-9583-4fa9-8b18-45b38f65b626 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1598 microversion: 2.20 time: 0.585425 Sep 05 12:19:42.130266 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 54/117] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:19:41 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1598 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:19:42.189283 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d399b818-d72e-45af-b20f-e52acf403400 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:42.189786 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d399b818-d72e-45af-b20f-e52acf403400 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:42.202034 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d399b818-d72e-45af-b20f-e52acf403400 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:42.205309 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d399b818-d72e-45af-b20f-e52acf403400 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:42.205771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d399b818-d72e-45af-b20f-e52acf403400 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:42.206803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d399b818-d72e-45af-b20f-e52acf403400 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:42.207390 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d399b818-d72e-45af-b20f-e52acf403400 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:42.208007 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d399b818-d72e-45af-b20f-e52acf403400 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:42.457407 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a2191a85-1cba-422e-8107-fcfe43f76bb6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:42.467892 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a2191a85-1cba-422e-8107-fcfe43f76bb6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1363 microversion: 2.1 time: 0.897380 Sep 05 12:19:42.483478 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 64/118] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:41 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1363 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:19:42.718132 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d399b818-d72e-45af-b20f-e52acf403400 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.534641 Sep 05 12:19:42.718868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 55/119] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Sep 5 12:19:42 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/os-interface => generated 284 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 12:19:43.507224 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a2825de6-1ec4-41a9-a499-c01e61241340 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:43.508860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a2825de6-1ec4-41a9-a499-c01e61241340 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:43.526918 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2825de6-1ec4-41a9-a499-c01e61241340 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:43.527782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2825de6-1ec4-41a9-a499-c01e61241340 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:43.528747 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2825de6-1ec4-41a9-a499-c01e61241340 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:43.529915 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2825de6-1ec4-41a9-a499-c01e61241340 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:43.530546 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2825de6-1ec4-41a9-a499-c01e61241340 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:43.531358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2825de6-1ec4-41a9-a499-c01e61241340 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:44.062206 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-fa2f4041-dd8b-4002-ae38-8b45961f56b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ac739da-4566-4f6f-b86a-2c46e36e8014"}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:19:44.069926 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-fa2f4041-dd8b-4002-ae38-8b45961f56b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:44.080220 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fa2f4041-dd8b-4002-ae38-8b45961f56b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:44.081215 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fa2f4041-dd8b-4002-ae38-8b45961f56b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:44.082225 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fa2f4041-dd8b-4002-ae38-8b45961f56b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:44.088385 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fa2f4041-dd8b-4002-ae38-8b45961f56b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:44.089430 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fa2f4041-dd8b-4002-ae38-8b45961f56b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:44.090318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fa2f4041-dd8b-4002-ae38-8b45961f56b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:44.420791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a2825de6-1ec4-41a9-a499-c01e61241340 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:44.429401 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=100 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:44.460288 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a2825de6-1ec4-41a9-a499-c01e61241340 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1363 microversion: 2.1 time: 0.968098 Sep 05 12:19:44.475806 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 65/120] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:43 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1363 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:44.806553 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-fa2f4041-dd8b-4002-ae38-8b45961f56b4 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "POST /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752312 Sep 05 12:19:44.807228 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 56/121] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Sep 5 12:19:44 2022] POST /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd/os-volume_attachments => generated 194 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:45.075614 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-ab8955ba-b421-40c2-a91b-ddf0f9c88f72 req-e581ca05-1942-4cae-9300-f620eb4b7e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78eb7b3-fb70-404b-b598-c80dd26f2827", "name": "network-vif-plugged", "status": "completed", "tag": "c7568900-c23a-4731-a0b3-57f3e306773b"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:19:45.100793 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-ab8955ba-b421-40c2-a91b-ddf0f9c88f72 req-e581ca05-1942-4cae-9300-f620eb4b7e3f service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:45.102867 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-ab8955ba-b421-40c2-a91b-ddf0f9c88f72 req-e581ca05-1942-4cae-9300-f620eb4b7e3f service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:45.104137 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-ab8955ba-b421-40c2-a91b-ddf0f9c88f72 req-e581ca05-1942-4cae-9300-f620eb4b7e3f service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:45.136619 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-ab8955ba-b421-40c2-a91b-ddf0f9c88f72 req-e581ca05-1942-4cae-9300-f620eb4b7e3f service nova] Creating event network-vif-plugged:c7568900-c23a-4731-a0b3-57f3e306773b for instance b78eb7b3-fb70-404b-b598-c80dd26f2827 on hv-cinder-85518 Sep 05 12:19:45.154132 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-ab8955ba-b421-40c2-a91b-ddf0f9c88f72 req-e581ca05-1942-4cae-9300-f620eb4b7e3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085320 Sep 05 12:19:45.155565 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 66/122] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:19:45.521541 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a9f24fd0-fc9c-47b6-89f0-749ed1f20973 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:45.533267 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a9f24fd0-fc9c-47b6-89f0-749ed1f20973 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:45.559819 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9f24fd0-fc9c-47b6-89f0-749ed1f20973 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:45.560313 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9f24fd0-fc9c-47b6-89f0-749ed1f20973 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:45.574752 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9f24fd0-fc9c-47b6-89f0-749ed1f20973 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:45.577252 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9f24fd0-fc9c-47b6-89f0-749ed1f20973 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:45.578346 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9f24fd0-fc9c-47b6-89f0-749ed1f20973 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:45.580740 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9f24fd0-fc9c-47b6-89f0-749ed1f20973 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:46.147002 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-4b044bf2-289a-4c84-b834-ca2f4236257e req-4322659b-5723-46da-af98-6ea1e8d0da6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78cd9ae3-2a60-4905-a291-30169e41c86c", "tag": "6a5ea4f2-8220-4378-84c2-dc1b033a8dd0"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:19:46.171383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:46.173601 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-4b044bf2-289a-4c84-b834-ca2f4236257e req-4322659b-5723-46da-af98-6ea1e8d0da6a service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:46.179307 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-4b044bf2-289a-4c84-b834-ca2f4236257e req-4322659b-5723-46da-af98-6ea1e8d0da6a service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:46.179990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-4b044bf2-289a-4c84-b834-ca2f4236257e req-4322659b-5723-46da-af98-6ea1e8d0da6a service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:46.206740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-4b044bf2-289a-4c84-b834-ca2f4236257e req-4322659b-5723-46da-af98-6ea1e8d0da6a service nova] Creating event network-changed:6a5ea4f2-8220-4378-84c2-dc1b033a8dd0 for instance 78cd9ae3-2a60-4905-a291-30169e41c86c on hv-cinder-85518 Sep 05 12:19:46.223155 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-4b044bf2-289a-4c84-b834-ca2f4236257e req-4322659b-5723-46da-af98-6ea1e8d0da6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085235 Sep 05 12:19:46.228538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 67/123] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:19:46.364634 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a9f24fd0-fc9c-47b6-89f0-749ed1f20973 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:46.389744 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a9f24fd0-fc9c-47b6-89f0-749ed1f20973 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1363 microversion: 2.1 time: 0.885499 Sep 05 12:19:46.406256 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 57/124] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:45 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1363 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:47.425352 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1b93305f-8329-46b7-ae5d-a50b577ad44c tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:47.432409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1b93305f-8329-46b7-ae5d-a50b577ad44c tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:47.470751 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1b93305f-8329-46b7-ae5d-a50b577ad44c tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:47.472375 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1b93305f-8329-46b7-ae5d-a50b577ad44c tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:47.477959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1b93305f-8329-46b7-ae5d-a50b577ad44c tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:47.479036 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1b93305f-8329-46b7-ae5d-a50b577ad44c tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:47.479791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1b93305f-8329-46b7-ae5d-a50b577ad44c tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:47.480386 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1b93305f-8329-46b7-ae5d-a50b577ad44c tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:47.805369 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1b93305f-8329-46b7-ae5d-a50b577ad44c tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:47.845834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1b93305f-8329-46b7-ae5d-a50b577ad44c tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1363 microversion: 2.1 time: 0.423419 Sep 05 12:19:47.845834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 68/125] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:47 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1363 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:48.865493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-3552e069-f53a-4cf2-9a5c-43d6376272b5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:48.866098 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3552e069-f53a-4cf2-9a5c-43d6376272b5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:48.880260 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3552e069-f53a-4cf2-9a5c-43d6376272b5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:48.883376 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3552e069-f53a-4cf2-9a5c-43d6376272b5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:48.884048 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3552e069-f53a-4cf2-9a5c-43d6376272b5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:48.885002 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3552e069-f53a-4cf2-9a5c-43d6376272b5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:48.885824 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3552e069-f53a-4cf2-9a5c-43d6376272b5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:48.890614 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3552e069-f53a-4cf2-9a5c-43d6376272b5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:49.221115 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-3552e069-f53a-4cf2-9a5c-43d6376272b5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:49.243981 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-3552e069-f53a-4cf2-9a5c-43d6376272b5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1549 microversion: 2.1 time: 0.374890 Sep 05 12:19:49.249800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 58/126] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:48 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1549 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:49.278236 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-15010e18-9ab3-4530-9daa-00beeeb1e1e8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:49.280184 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-15010e18-9ab3-4530-9daa-00beeeb1e1e8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:49.293536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-15010e18-9ab3-4530-9daa-00beeeb1e1e8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:49.294257 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-15010e18-9ab3-4530-9daa-00beeeb1e1e8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:49.295060 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-15010e18-9ab3-4530-9daa-00beeeb1e1e8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:49.296849 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-15010e18-9ab3-4530-9daa-00beeeb1e1e8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:49.297312 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-15010e18-9ab3-4530-9daa-00beeeb1e1e8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:49.298338 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-15010e18-9ab3-4530-9daa-00beeeb1e1e8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:49.582689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-15010e18-9ab3-4530-9daa-00beeeb1e1e8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.309382 Sep 05 12:19:49.584245 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 69/127] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Sep 5 12:19:49 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/os-interface => generated 284 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:51.787766 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-fa35f768-30c0-4134-b63e-7ae6bb008831 req-7d6f4688-300b-4621-891e-d16bc9aaa103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b78eb7b3-fb70-404b-b598-c80dd26f2827", "tag": "c7568900-c23a-4731-a0b3-57f3e306773b"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:19:51.796905 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=58 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:51.810445 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-fa35f768-30c0-4134-b63e-7ae6bb008831 req-7d6f4688-300b-4621-891e-d16bc9aaa103 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:51.813668 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-fa35f768-30c0-4134-b63e-7ae6bb008831 req-7d6f4688-300b-4621-891e-d16bc9aaa103 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:51.814253 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-fa35f768-30c0-4134-b63e-7ae6bb008831 req-7d6f4688-300b-4621-891e-d16bc9aaa103 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:51.834391 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-fa35f768-30c0-4134-b63e-7ae6bb008831 req-7d6f4688-300b-4621-891e-d16bc9aaa103 service nova] Creating event network-changed:c7568900-c23a-4731-a0b3-57f3e306773b for instance b78eb7b3-fb70-404b-b598-c80dd26f2827 on hv-cinder-85518 Sep 05 12:19:51.874201 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-fa35f768-30c0-4134-b63e-7ae6bb008831 req-7d6f4688-300b-4621-891e-d16bc9aaa103 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090714 Sep 05 12:19:51.874822 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 59/128] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:19:56.525807 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4969fbe3-f663-4a27-bc74-fa9abb9b4531 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:56.527807 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4969fbe3-f663-4a27-bc74-fa9abb9b4531 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:56.538003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4969fbe3-f663-4a27-bc74-fa9abb9b4531 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:56.538880 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4969fbe3-f663-4a27-bc74-fa9abb9b4531 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:56.539468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4969fbe3-f663-4a27-bc74-fa9abb9b4531 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:56.540623 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4969fbe3-f663-4a27-bc74-fa9abb9b4531 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:56.541600 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4969fbe3-f663-4a27-bc74-fa9abb9b4531 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:56.542385 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4969fbe3-f663-4a27-bc74-fa9abb9b4531 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:56.623546 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4969fbe3-f663-4a27-bc74-fa9abb9b4531 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Going to try to terminate instance {{(pid=120534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:19:56.773828 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4969fbe3-f663-4a27-bc74-fa9abb9b4531 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 204 len: 0 microversion: 2.1 time: 0.257845 Sep 05 12:19:56.775216 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 70/129] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:19:56 2022] DELETE /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:19:56.787752 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a2d161b2-8276-40a3-a350-4630586d6282 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:56.788655 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a2d161b2-8276-40a3-a350-4630586d6282 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:56.802195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a2d161b2-8276-40a3-a350-4630586d6282 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:56.802817 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a2d161b2-8276-40a3-a350-4630586d6282 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:56.803835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a2d161b2-8276-40a3-a350-4630586d6282 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:56.805029 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a2d161b2-8276-40a3-a350-4630586d6282 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:56.805756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a2d161b2-8276-40a3-a350-4630586d6282 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:56.807149 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a2d161b2-8276-40a3-a350-4630586d6282 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:57.065224 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a2d161b2-8276-40a3-a350-4630586d6282 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:57.069295 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:57.074916 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a2d161b2-8276-40a3-a350-4630586d6282 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1555 microversion: 2.1 time: 0.293125 Sep 05 12:19:57.075618 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 60/130] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:56 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1555 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:19:58.102879 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-54117959-97f9-42cb-a47c-ecfdbc25f474 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:58.104547 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-54117959-97f9-42cb-a47c-ecfdbc25f474 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:58.112335 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-54117959-97f9-42cb-a47c-ecfdbc25f474 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:58.113056 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-54117959-97f9-42cb-a47c-ecfdbc25f474 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:58.113725 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-54117959-97f9-42cb-a47c-ecfdbc25f474 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:58.114657 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-54117959-97f9-42cb-a47c-ecfdbc25f474 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:58.115332 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-54117959-97f9-42cb-a47c-ecfdbc25f474 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:58.115992 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-54117959-97f9-42cb-a47c-ecfdbc25f474 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:58.294796 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-54117959-97f9-42cb-a47c-ecfdbc25f474 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:58.304872 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-54117959-97f9-42cb-a47c-ecfdbc25f474 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1555 microversion: 2.1 time: 0.209655 Sep 05 12:19:58.305482 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 71/131] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:58 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:19:59.331375 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-aaf8c430-9393-4d16-881f-650694f29294 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:19:59.333047 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-aaf8c430-9393-4d16-881f-650694f29294 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:19:59.341024 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aaf8c430-9393-4d16-881f-650694f29294 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:59.341514 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aaf8c430-9393-4d16-881f-650694f29294 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:59.344342 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aaf8c430-9393-4d16-881f-650694f29294 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:59.344342 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aaf8c430-9393-4d16-881f-650694f29294 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:19:59.344342 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aaf8c430-9393-4d16-881f-650694f29294 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:19:59.344342 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aaf8c430-9393-4d16-881f-650694f29294 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:19:59.492289 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-aaf8c430-9393-4d16-881f-650694f29294 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:19:59.503787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-aaf8c430-9393-4d16-881f-650694f29294 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1555 microversion: 2.1 time: 0.177490 Sep 05 12:19:59.503787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 61/132] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:19:59 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:00.526664 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-31139b31-3245-4135-962d-8f5536d372d1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:00.527230 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-31139b31-3245-4135-962d-8f5536d372d1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:00.533963 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-31139b31-3245-4135-962d-8f5536d372d1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:00.534440 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-31139b31-3245-4135-962d-8f5536d372d1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:00.534877 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-31139b31-3245-4135-962d-8f5536d372d1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:00.535614 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-31139b31-3245-4135-962d-8f5536d372d1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:00.536067 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-31139b31-3245-4135-962d-8f5536d372d1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:00.536488 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-31139b31-3245-4135-962d-8f5536d372d1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:00.667629 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-31139b31-3245-4135-962d-8f5536d372d1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:00.676267 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-31139b31-3245-4135-962d-8f5536d372d1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1555 microversion: 2.1 time: 0.153769 Sep 05 12:20:00.676850 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 72/133] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:00 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:01.698419 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-aa7ca3bd-fd8a-41a7-b10d-4b5a2e5bb6d3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:01.699024 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-aa7ca3bd-fd8a-41a7-b10d-4b5a2e5bb6d3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:01.705817 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa7ca3bd-fd8a-41a7-b10d-4b5a2e5bb6d3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:01.706306 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa7ca3bd-fd8a-41a7-b10d-4b5a2e5bb6d3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:01.706746 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa7ca3bd-fd8a-41a7-b10d-4b5a2e5bb6d3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:01.707457 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa7ca3bd-fd8a-41a7-b10d-4b5a2e5bb6d3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:01.707950 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa7ca3bd-fd8a-41a7-b10d-4b5a2e5bb6d3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:01.708382 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa7ca3bd-fd8a-41a7-b10d-4b5a2e5bb6d3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:01.855855 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-aa7ca3bd-fd8a-41a7-b10d-4b5a2e5bb6d3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:01.865347 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-aa7ca3bd-fd8a-41a7-b10d-4b5a2e5bb6d3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1555 microversion: 2.1 time: 0.170806 Sep 05 12:20:01.865933 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 62/134] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:01 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:02.888856 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a1fe1166-da36-4a2a-ab2c-ef2e57742f0a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:02.889505 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a1fe1166-da36-4a2a-ab2c-ef2e57742f0a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:02.895760 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a1fe1166-da36-4a2a-ab2c-ef2e57742f0a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:02.896247 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a1fe1166-da36-4a2a-ab2c-ef2e57742f0a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:02.896713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a1fe1166-da36-4a2a-ab2c-ef2e57742f0a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:02.897424 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a1fe1166-da36-4a2a-ab2c-ef2e57742f0a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:02.897881 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a1fe1166-da36-4a2a-ab2c-ef2e57742f0a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:02.898315 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a1fe1166-da36-4a2a-ab2c-ef2e57742f0a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:03.042871 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a1fe1166-da36-4a2a-ab2c-ef2e57742f0a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:03.051572 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a1fe1166-da36-4a2a-ab2c-ef2e57742f0a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1555 microversion: 2.1 time: 0.166653 Sep 05 12:20:03.052171 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 73/135] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:02 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:04.025484 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-ce4de06a-a48b-4a50-90d5-649c42a0caa0 req-854a1a36-4be7-42e8-b54f-d4e073da92af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe593696-0213-453f-8fcb-ce9b0b0bcabd", "name": "network-vif-unplugged", "status": "completed", "tag": "f78ef43d-1938-4202-a109-c89734c83e90"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:20:04.051558 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-ce4de06a-a48b-4a50-90d5-649c42a0caa0 req-854a1a36-4be7-42e8-b54f-d4e073da92af service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:04.052443 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-ce4de06a-a48b-4a50-90d5-649c42a0caa0 req-854a1a36-4be7-42e8-b54f-d4e073da92af service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:04.053456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-ce4de06a-a48b-4a50-90d5-649c42a0caa0 req-854a1a36-4be7-42e8-b54f-d4e073da92af service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:04.077108 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-87d41535-db72-45c3-b135-4481e27f52fb tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:04.078690 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-ce4de06a-a48b-4a50-90d5-649c42a0caa0 req-854a1a36-4be7-42e8-b54f-d4e073da92af service nova] Creating event network-vif-unplugged:f78ef43d-1938-4202-a109-c89734c83e90 for instance fe593696-0213-453f-8fcb-ce9b0b0bcabd on hv-cinder-85518 Sep 05 12:20:04.080097 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-87d41535-db72-45c3-b135-4481e27f52fb tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:04.089731 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-ce4de06a-a48b-4a50-90d5-649c42a0caa0 req-854a1a36-4be7-42e8-b54f-d4e073da92af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069808 Sep 05 12:20:04.091123 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 63/136] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:20:04.096889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87d41535-db72-45c3-b135-4481e27f52fb tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:04.097999 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87d41535-db72-45c3-b135-4481e27f52fb tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:04.098456 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87d41535-db72-45c3-b135-4481e27f52fb tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:04.100177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87d41535-db72-45c3-b135-4481e27f52fb tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:04.101083 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87d41535-db72-45c3-b135-4481e27f52fb tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:04.101857 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87d41535-db72-45c3-b135-4481e27f52fb tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:04.315551 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-87d41535-db72-45c3-b135-4481e27f52fb tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:04.325400 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-87d41535-db72-45c3-b135-4481e27f52fb tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1555 microversion: 2.1 time: 0.254175 Sep 05 12:20:04.326932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 74/137] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:04 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1555 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:04.637910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-4a2281c4-4d18-4b7b-b97d-736803cb3283 req-61f3e715-e816-4900-afd6-d6202a284a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe593696-0213-453f-8fcb-ce9b0b0bcabd", "name": "network-vif-deleted", "tag": "f78ef43d-1938-4202-a109-c89734c83e90"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:20:04.661693 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-4a2281c4-4d18-4b7b-b97d-736803cb3283 req-61f3e715-e816-4900-afd6-d6202a284a09 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:04.662645 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-4a2281c4-4d18-4b7b-b97d-736803cb3283 req-61f3e715-e816-4900-afd6-d6202a284a09 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:04.664169 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-4a2281c4-4d18-4b7b-b97d-736803cb3283 req-61f3e715-e816-4900-afd6-d6202a284a09 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:04.702182 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-4a2281c4-4d18-4b7b-b97d-736803cb3283 req-61f3e715-e816-4900-afd6-d6202a284a09 service nova] Creating event network-vif-deleted:f78ef43d-1938-4202-a109-c89734c83e90 for instance fe593696-0213-453f-8fcb-ce9b0b0bcabd on hv-cinder-85518 Sep 05 12:20:04.714449 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-4a2281c4-4d18-4b7b-b97d-736803cb3283 req-61f3e715-e816-4900-afd6-d6202a284a09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085383 Sep 05 12:20:04.715911 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 64/138] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:20:05.361523 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-aba92a16-a544-4fbb-82bc-ea816cc96b16 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:05.362379 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-aba92a16-a544-4fbb-82bc-ea816cc96b16 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:05.369878 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-aba92a16-a544-4fbb-82bc-ea816cc96b16 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:05.370587 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-aba92a16-a544-4fbb-82bc-ea816cc96b16 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:05.371079 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-aba92a16-a544-4fbb-82bc-ea816cc96b16 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:05.372057 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-aba92a16-a544-4fbb-82bc-ea816cc96b16 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:05.372635 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-aba92a16-a544-4fbb-82bc-ea816cc96b16 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:05.373205 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-aba92a16-a544-4fbb-82bc-ea816cc96b16 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:05.452046 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-aba92a16-a544-4fbb-82bc-ea816cc96b16 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:05.461566 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-aba92a16-a544-4fbb-82bc-ea816cc96b16 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1513 microversion: 2.1 time: 0.104113 Sep 05 12:20:05.462161 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 75/139] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:05 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1513 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:06.497000 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f6bace80-e7d6-4140-927b-ed99bd934476 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:06.497993 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f6bace80-e7d6-4140-927b-ed99bd934476 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:06.505030 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f6bace80-e7d6-4140-927b-ed99bd934476 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:06.505512 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f6bace80-e7d6-4140-927b-ed99bd934476 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:06.505946 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f6bace80-e7d6-4140-927b-ed99bd934476 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:06.507033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f6bace80-e7d6-4140-927b-ed99bd934476 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:06.507656 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f6bace80-e7d6-4140-927b-ed99bd934476 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:06.508102 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f6bace80-e7d6-4140-927b-ed99bd934476 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:06.609721 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f6bace80-e7d6-4140-927b-ed99bd934476 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:06.625936 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f6bace80-e7d6-4140-927b-ed99bd934476 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1513 microversion: 2.1 time: 0.134610 Sep 05 12:20:06.626614 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 65/140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:06 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1513 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:07.656320 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-41a03d7f-2d5c-4d17-b95d-f667ec86317d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:07.657321 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-41a03d7f-2d5c-4d17-b95d-f667ec86317d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:07.667034 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-41a03d7f-2d5c-4d17-b95d-f667ec86317d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:07.667547 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-41a03d7f-2d5c-4d17-b95d-f667ec86317d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:07.667986 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-41a03d7f-2d5c-4d17-b95d-f667ec86317d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:07.668709 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-41a03d7f-2d5c-4d17-b95d-f667ec86317d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:07.669163 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-41a03d7f-2d5c-4d17-b95d-f667ec86317d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:07.669583 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-41a03d7f-2d5c-4d17-b95d-f667ec86317d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:07.740479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-41a03d7f-2d5c-4d17-b95d-f667ec86317d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:07.752972 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-41a03d7f-2d5c-4d17-b95d-f667ec86317d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1513 microversion: 2.1 time: 0.103621 Sep 05 12:20:07.754519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 76/141] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:07 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1513 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:08.782978 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0c600085-d080-47c5-b9f4-2b5b60db26f8 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:08.784269 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0c600085-d080-47c5-b9f4-2b5b60db26f8 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:08.793871 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0c600085-d080-47c5-b9f4-2b5b60db26f8 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:08.794787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0c600085-d080-47c5-b9f4-2b5b60db26f8 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:08.795495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0c600085-d080-47c5-b9f4-2b5b60db26f8 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:08.796471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0c600085-d080-47c5-b9f4-2b5b60db26f8 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:08.797991 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0c600085-d080-47c5-b9f4-2b5b60db26f8 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:08.798415 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0c600085-d080-47c5-b9f4-2b5b60db26f8 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:08.869380 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0c600085-d080-47c5-b9f4-2b5b60db26f8 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:08.878947 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0c600085-d080-47c5-b9f4-2b5b60db26f8 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1513 microversion: 2.1 time: 0.102672 Sep 05 12:20:08.879818 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 66/142] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:08 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1513 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:20:09.902926 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-04b176c4-7047-4d6d-bd95-56de208bbe9d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:09.903734 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-04b176c4-7047-4d6d-bd95-56de208bbe9d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:09.911066 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-04b176c4-7047-4d6d-bd95-56de208bbe9d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:09.911631 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-04b176c4-7047-4d6d-bd95-56de208bbe9d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:09.912028 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-04b176c4-7047-4d6d-bd95-56de208bbe9d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:09.912750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-04b176c4-7047-4d6d-bd95-56de208bbe9d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:09.913211 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-04b176c4-7047-4d6d-bd95-56de208bbe9d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:09.913638 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-04b176c4-7047-4d6d-bd95-56de208bbe9d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:09.991703 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-04b176c4-7047-4d6d-bd95-56de208bbe9d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:10.008735 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-04b176c4-7047-4d6d-bd95-56de208bbe9d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1513 microversion: 2.1 time: 0.109953 Sep 05 12:20:10.009724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 77/143] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:09 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1513 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:11.034816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-bda775ca-fc5d-46f7-aaa8-7e21a2b020c2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:11.035727 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-bda775ca-fc5d-46f7-aaa8-7e21a2b020c2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:11.044359 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bda775ca-fc5d-46f7-aaa8-7e21a2b020c2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:11.045161 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bda775ca-fc5d-46f7-aaa8-7e21a2b020c2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:11.045925 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bda775ca-fc5d-46f7-aaa8-7e21a2b020c2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:11.047116 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bda775ca-fc5d-46f7-aaa8-7e21a2b020c2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:11.048425 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bda775ca-fc5d-46f7-aaa8-7e21a2b020c2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:11.049132 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bda775ca-fc5d-46f7-aaa8-7e21a2b020c2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:11.135492 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-bda775ca-fc5d-46f7-aaa8-7e21a2b020c2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:11.152075 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-bda775ca-fc5d-46f7-aaa8-7e21a2b020c2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1513 microversion: 2.1 time: 0.120944 Sep 05 12:20:11.153312 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 67/144] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:11 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1513 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:12.184422 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9e31d66e-ddf7-4db8-91b1-5c3ff61297b2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:12.185430 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9e31d66e-ddf7-4db8-91b1-5c3ff61297b2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:12.194371 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9e31d66e-ddf7-4db8-91b1-5c3ff61297b2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:12.195044 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9e31d66e-ddf7-4db8-91b1-5c3ff61297b2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:12.195642 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9e31d66e-ddf7-4db8-91b1-5c3ff61297b2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:12.196581 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9e31d66e-ddf7-4db8-91b1-5c3ff61297b2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:12.197278 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9e31d66e-ddf7-4db8-91b1-5c3ff61297b2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:12.197929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9e31d66e-ddf7-4db8-91b1-5c3ff61297b2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:12.289750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9e31d66e-ddf7-4db8-91b1-5c3ff61297b2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:12.301340 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9e31d66e-ddf7-4db8-91b1-5c3ff61297b2 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1513 microversion: 2.1 time: 0.121824 Sep 05 12:20:12.302019 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 78/145] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:12 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1513 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:13.330337 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-24378793-acfb-426d-9877-9cd7558f599c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:13.331395 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-24378793-acfb-426d-9877-9cd7558f599c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:13.352150 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-24378793-acfb-426d-9877-9cd7558f599c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:13.352150 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-24378793-acfb-426d-9877-9cd7558f599c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:13.352150 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-24378793-acfb-426d-9877-9cd7558f599c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:13.352150 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-24378793-acfb-426d-9877-9cd7558f599c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:13.352902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-24378793-acfb-426d-9877-9cd7558f599c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:13.352902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-24378793-acfb-426d-9877-9cd7558f599c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:13.436239 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-24378793-acfb-426d-9877-9cd7558f599c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:13.445177 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-24378793-acfb-426d-9877-9cd7558f599c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1513 microversion: 2.1 time: 0.120502 Sep 05 12:20:13.445828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 68/146] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:13 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1513 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:20:14.474079 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a8d9046c-7a6c-4292-954a-c68f42e7ee14 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:14.474079 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a8d9046c-7a6c-4292-954a-c68f42e7ee14 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:14.483818 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a8d9046c-7a6c-4292-954a-c68f42e7ee14 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:14.485677 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a8d9046c-7a6c-4292-954a-c68f42e7ee14 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:14.486451 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a8d9046c-7a6c-4292-954a-c68f42e7ee14 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:14.488198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a8d9046c-7a6c-4292-954a-c68f42e7ee14 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:14.489225 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a8d9046c-7a6c-4292-954a-c68f42e7ee14 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:14.489829 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a8d9046c-7a6c-4292-954a-c68f42e7ee14 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:14.589940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a8d9046c-7a6c-4292-954a-c68f42e7ee14 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:14.600754 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a8d9046c-7a6c-4292-954a-c68f42e7ee14 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1513 microversion: 2.1 time: 0.133829 Sep 05 12:20:14.601356 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 79/147] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:14 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1513 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:20:15.628316 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-62acd199-8e71-4092-a5ba-c761754daf1d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:15.629028 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-62acd199-8e71-4092-a5ba-c761754daf1d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:15.639474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62acd199-8e71-4092-a5ba-c761754daf1d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:15.640300 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62acd199-8e71-4092-a5ba-c761754daf1d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:15.641069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62acd199-8e71-4092-a5ba-c761754daf1d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:15.642307 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62acd199-8e71-4092-a5ba-c761754daf1d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:15.643175 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62acd199-8e71-4092-a5ba-c761754daf1d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:15.644008 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62acd199-8e71-4092-a5ba-c761754daf1d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:15.754778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-62acd199-8e71-4092-a5ba-c761754daf1d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:15.764059 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-62acd199-8e71-4092-a5ba-c761754daf1d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1513 microversion: 2.1 time: 0.140784 Sep 05 12:20:15.764655 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 69/148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:15 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:16.788875 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1326c4ea-7bc2-44cd-a75c-1be4e6bfe42c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:16.789495 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1326c4ea-7bc2-44cd-a75c-1be4e6bfe42c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:16.796102 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1326c4ea-7bc2-44cd-a75c-1be4e6bfe42c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:16.796589 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1326c4ea-7bc2-44cd-a75c-1be4e6bfe42c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:16.797030 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1326c4ea-7bc2-44cd-a75c-1be4e6bfe42c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:16.797755 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1326c4ea-7bc2-44cd-a75c-1be4e6bfe42c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:16.798213 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1326c4ea-7bc2-44cd-a75c-1be4e6bfe42c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:16.798639 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1326c4ea-7bc2-44cd-a75c-1be4e6bfe42c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:16.801883 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:16.885276 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1326c4ea-7bc2-44cd-a75c-1be4e6bfe42c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:16.901879 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1326c4ea-7bc2-44cd-a75c-1be4e6bfe42c tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1513 microversion: 2.1 time: 0.116759 Sep 05 12:20:16.902942 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 80/149] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:16 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1513 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:17.926540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-aeaadab4-57c0-45ec-81ce-43ab8fedc2e3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:17.927259 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-aeaadab4-57c0-45ec-81ce-43ab8fedc2e3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:17.934570 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aeaadab4-57c0-45ec-81ce-43ab8fedc2e3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:17.935050 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aeaadab4-57c0-45ec-81ce-43ab8fedc2e3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:17.935475 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aeaadab4-57c0-45ec-81ce-43ab8fedc2e3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:17.936210 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aeaadab4-57c0-45ec-81ce-43ab8fedc2e3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:17.936661 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aeaadab4-57c0-45ec-81ce-43ab8fedc2e3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:17.937085 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aeaadab4-57c0-45ec-81ce-43ab8fedc2e3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:18.018530 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-aeaadab4-57c0-45ec-81ce-43ab8fedc2e3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:18.028845 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-aeaadab4-57c0-45ec-81ce-43ab8fedc2e3 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1513 microversion: 2.1 time: 0.106753 Sep 05 12:20:18.029626 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 70/150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:17 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1513 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:19.056108 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-144be079-0236-4a5b-8db0-14bf711b7a93 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:19.056851 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-144be079-0236-4a5b-8db0-14bf711b7a93 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:19.058865 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:19.065030 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-144be079-0236-4a5b-8db0-14bf711b7a93 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:19.065517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-144be079-0236-4a5b-8db0-14bf711b7a93 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:19.065953 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-144be079-0236-4a5b-8db0-14bf711b7a93 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:19.066675 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-144be079-0236-4a5b-8db0-14bf711b7a93 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:19.067133 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-144be079-0236-4a5b-8db0-14bf711b7a93 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:19.067595 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-144be079-0236-4a5b-8db0-14bf711b7a93 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:19.136465 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-144be079-0236-4a5b-8db0-14bf711b7a93 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:19.146201 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-144be079-0236-4a5b-8db0-14bf711b7a93 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1513 microversion: 2.1 time: 0.093934 Sep 05 12:20:19.146796 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 81/151] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:19 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1513 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:20.181765 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4af10d70-6cb9-466e-a523-25f865ac9cd6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:20.182515 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4af10d70-6cb9-466e-a523-25f865ac9cd6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:20.191130 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4af10d70-6cb9-466e-a523-25f865ac9cd6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:20.191694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4af10d70-6cb9-466e-a523-25f865ac9cd6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:20.192178 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4af10d70-6cb9-466e-a523-25f865ac9cd6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:20.192934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4af10d70-6cb9-466e-a523-25f865ac9cd6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:20.193382 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4af10d70-6cb9-466e-a523-25f865ac9cd6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:20.193863 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4af10d70-6cb9-466e-a523-25f865ac9cd6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:20.271043 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4af10d70-6cb9-466e-a523-25f865ac9cd6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:20.289315 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4af10d70-6cb9-466e-a523-25f865ac9cd6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1346 microversion: 2.1 time: 0.111319 Sep 05 12:20:20.290364 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 71/152] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:20 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:21.330747 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c48f0597-c3a0-4272-bd66-233d5ff22e0b tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:21.331281 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c48f0597-c3a0-4272-bd66-233d5ff22e0b tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:21.337408 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c48f0597-c3a0-4272-bd66-233d5ff22e0b tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:21.337886 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c48f0597-c3a0-4272-bd66-233d5ff22e0b tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:21.338318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c48f0597-c3a0-4272-bd66-233d5ff22e0b tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:21.339006 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c48f0597-c3a0-4272-bd66-233d5ff22e0b tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:21.339456 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c48f0597-c3a0-4272-bd66-233d5ff22e0b tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:21.339905 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c48f0597-c3a0-4272-bd66-233d5ff22e0b tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:21.415101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c48f0597-c3a0-4272-bd66-233d5ff22e0b tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:21.424974 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c48f0597-c3a0-4272-bd66-233d5ff22e0b tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1346 microversion: 2.1 time: 0.100255 Sep 05 12:20:21.425563 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 82/153] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:21 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:22.466108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9239cd24-9f34-4445-a3b6-00c84a6f919d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:22.467243 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-9239cd24-9f34-4445-a3b6-00c84a6f919d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:22.471277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=26 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:22.481805 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9239cd24-9f34-4445-a3b6-00c84a6f919d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:22.482681 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9239cd24-9f34-4445-a3b6-00c84a6f919d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:22.483466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9239cd24-9f34-4445-a3b6-00c84a6f919d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:22.485302 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9239cd24-9f34-4445-a3b6-00c84a6f919d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:22.486183 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9239cd24-9f34-4445-a3b6-00c84a6f919d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:22.487217 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9239cd24-9f34-4445-a3b6-00c84a6f919d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:22.581771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-9239cd24-9f34-4445-a3b6-00c84a6f919d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:22.590360 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9239cd24-9f34-4445-a3b6-00c84a6f919d tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1346 microversion: 2.1 time: 0.130661 Sep 05 12:20:22.590951 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 72/154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:22 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:23.616607 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-600eff2c-95f5-47c6-8daf-1dff74de04de tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:23.617206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-600eff2c-95f5-47c6-8daf-1dff74de04de tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:23.624187 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-600eff2c-95f5-47c6-8daf-1dff74de04de tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:23.624679 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-600eff2c-95f5-47c6-8daf-1dff74de04de tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:23.625111 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-600eff2c-95f5-47c6-8daf-1dff74de04de tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:23.625916 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-600eff2c-95f5-47c6-8daf-1dff74de04de tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:23.626496 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-600eff2c-95f5-47c6-8daf-1dff74de04de tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:23.627020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-600eff2c-95f5-47c6-8daf-1dff74de04de tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:23.694761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-600eff2c-95f5-47c6-8daf-1dff74de04de tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:23.705746 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-600eff2c-95f5-47c6-8daf-1dff74de04de tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1346 microversion: 2.1 time: 0.092980 Sep 05 12:20:23.706524 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 83/155] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:23 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:24.729660 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-01689a82-dbd5-47a6-a612-c5428811ddb1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:24.730269 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-01689a82-dbd5-47a6-a612-c5428811ddb1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:24.738126 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-01689a82-dbd5-47a6-a612-c5428811ddb1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:24.738730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-01689a82-dbd5-47a6-a612-c5428811ddb1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:24.739230 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-01689a82-dbd5-47a6-a612-c5428811ddb1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:24.740078 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-01689a82-dbd5-47a6-a612-c5428811ddb1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:24.740573 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-01689a82-dbd5-47a6-a612-c5428811ddb1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:24.741038 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-01689a82-dbd5-47a6-a612-c5428811ddb1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:24.815983 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-01689a82-dbd5-47a6-a612-c5428811ddb1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:24.830828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-01689a82-dbd5-47a6-a612-c5428811ddb1 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1346 microversion: 2.1 time: 0.104545 Sep 05 12:20:24.831906 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 73/156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:24 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:25.859457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-641eb313-1346-4126-8aa5-8579741818fe tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:25.861268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-641eb313-1346-4126-8aa5-8579741818fe tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:25.872583 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-641eb313-1346-4126-8aa5-8579741818fe tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:25.873440 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-641eb313-1346-4126-8aa5-8579741818fe tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:25.874222 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-641eb313-1346-4126-8aa5-8579741818fe tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:25.875492 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-641eb313-1346-4126-8aa5-8579741818fe tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:25.876421 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-641eb313-1346-4126-8aa5-8579741818fe tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:25.877192 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-641eb313-1346-4126-8aa5-8579741818fe tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:25.976832 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-641eb313-1346-4126-8aa5-8579741818fe tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:25.985606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-641eb313-1346-4126-8aa5-8579741818fe tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1346 microversion: 2.1 time: 0.133495 Sep 05 12:20:25.986204 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 84/157] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:25 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1346 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:27.010709 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-442e07c4-1355-4e03-bd5b-ebd5e063e108 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:27.011981 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-442e07c4-1355-4e03-bd5b-ebd5e063e108 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:27.020878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-442e07c4-1355-4e03-bd5b-ebd5e063e108 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:27.021555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-442e07c4-1355-4e03-bd5b-ebd5e063e108 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:27.022529 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-442e07c4-1355-4e03-bd5b-ebd5e063e108 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:27.023573 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-442e07c4-1355-4e03-bd5b-ebd5e063e108 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:27.024757 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-442e07c4-1355-4e03-bd5b-ebd5e063e108 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:27.025228 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-442e07c4-1355-4e03-bd5b-ebd5e063e108 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:27.102825 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-442e07c4-1355-4e03-bd5b-ebd5e063e108 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:27.113095 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-442e07c4-1355-4e03-bd5b-ebd5e063e108 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1346 microversion: 2.1 time: 0.108087 Sep 05 12:20:27.113835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 74/158] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:27 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:28.144992 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-aa35a429-4b2f-4ba3-a27b-63b3f622e4c6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:28.145880 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-aa35a429-4b2f-4ba3-a27b-63b3f622e4c6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:28.155185 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-aa35a429-4b2f-4ba3-a27b-63b3f622e4c6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:28.155992 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-aa35a429-4b2f-4ba3-a27b-63b3f622e4c6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:28.156639 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-aa35a429-4b2f-4ba3-a27b-63b3f622e4c6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:28.158339 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-aa35a429-4b2f-4ba3-a27b-63b3f622e4c6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:28.158964 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-aa35a429-4b2f-4ba3-a27b-63b3f622e4c6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:28.159564 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-aa35a429-4b2f-4ba3-a27b-63b3f622e4c6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:28.253996 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-aa35a429-4b2f-4ba3-a27b-63b3f622e4c6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:28.264943 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-aa35a429-4b2f-4ba3-a27b-63b3f622e4c6 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1346 microversion: 2.1 time: 0.127604 Sep 05 12:20:28.265740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 85/159] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:28 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1346 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:20:29.298619 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-65ee8fc2-6d55-477e-a1d0-51d44aa35839 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:29.299247 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-65ee8fc2-6d55-477e-a1d0-51d44aa35839 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:29.305725 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65ee8fc2-6d55-477e-a1d0-51d44aa35839 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:29.306196 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65ee8fc2-6d55-477e-a1d0-51d44aa35839 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:29.306620 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65ee8fc2-6d55-477e-a1d0-51d44aa35839 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:29.307300 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65ee8fc2-6d55-477e-a1d0-51d44aa35839 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:29.307781 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65ee8fc2-6d55-477e-a1d0-51d44aa35839 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:29.308198 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65ee8fc2-6d55-477e-a1d0-51d44aa35839 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:29.380603 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-65ee8fc2-6d55-477e-a1d0-51d44aa35839 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:29.383779 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=81 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:29.395484 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-65ee8fc2-6d55-477e-a1d0-51d44aa35839 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1346 microversion: 2.1 time: 0.101096 Sep 05 12:20:29.403693 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 75/160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:29 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:30.420984 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-437c5d35-5d43-4775-9acb-46b7c77bad27 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:30.422577 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-437c5d35-5d43-4775-9acb-46b7c77bad27 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:30.433252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-437c5d35-5d43-4775-9acb-46b7c77bad27 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:30.434120 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-437c5d35-5d43-4775-9acb-46b7c77bad27 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:30.434940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-437c5d35-5d43-4775-9acb-46b7c77bad27 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:30.436101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-437c5d35-5d43-4775-9acb-46b7c77bad27 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:30.436901 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-437c5d35-5d43-4775-9acb-46b7c77bad27 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:30.438572 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-437c5d35-5d43-4775-9acb-46b7c77bad27 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:30.512489 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-437c5d35-5d43-4775-9acb-46b7c77bad27 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:30.521113 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-437c5d35-5d43-4775-9acb-46b7c77bad27 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1346 microversion: 2.1 time: 0.106357 Sep 05 12:20:30.521694 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 86/161] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:30 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:31.543760 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d8010a9c-ac5c-4559-8c83-8d3afece0314 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:31.544404 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d8010a9c-ac5c-4559-8c83-8d3afece0314 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:31.551788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d8010a9c-ac5c-4559-8c83-8d3afece0314 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:31.552319 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d8010a9c-ac5c-4559-8c83-8d3afece0314 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:31.552791 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d8010a9c-ac5c-4559-8c83-8d3afece0314 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:31.553478 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d8010a9c-ac5c-4559-8c83-8d3afece0314 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:31.553931 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d8010a9c-ac5c-4559-8c83-8d3afece0314 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:31.554352 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d8010a9c-ac5c-4559-8c83-8d3afece0314 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:31.617947 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d8010a9c-ac5c-4559-8c83-8d3afece0314 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:31.627291 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d8010a9c-ac5c-4559-8c83-8d3afece0314 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1346 microversion: 2.1 time: 0.087356 Sep 05 12:20:31.627923 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 76/162] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:31 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:32.657802 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1ee89b44-b5c8-4139-bf2d-dca356338066 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:32.658414 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1ee89b44-b5c8-4139-bf2d-dca356338066 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:32.665263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1ee89b44-b5c8-4139-bf2d-dca356338066 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:32.665765 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1ee89b44-b5c8-4139-bf2d-dca356338066 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:32.666182 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1ee89b44-b5c8-4139-bf2d-dca356338066 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:32.666913 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1ee89b44-b5c8-4139-bf2d-dca356338066 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:32.667432 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1ee89b44-b5c8-4139-bf2d-dca356338066 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:32.667904 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1ee89b44-b5c8-4139-bf2d-dca356338066 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:32.733254 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1ee89b44-b5c8-4139-bf2d-dca356338066 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:32.742519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1ee89b44-b5c8-4139-bf2d-dca356338066 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1346 microversion: 2.1 time: 0.088562 Sep 05 12:20:32.743108 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 87/163] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:32 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:33.770287 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8e99af3a-36f6-4077-9048-9024cbca2198 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:33.771438 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8e99af3a-36f6-4077-9048-9024cbca2198 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:33.782896 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e99af3a-36f6-4077-9048-9024cbca2198 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:33.783923 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e99af3a-36f6-4077-9048-9024cbca2198 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:33.784127 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e99af3a-36f6-4077-9048-9024cbca2198 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:33.784920 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e99af3a-36f6-4077-9048-9024cbca2198 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:33.785446 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e99af3a-36f6-4077-9048-9024cbca2198 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:33.785895 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e99af3a-36f6-4077-9048-9024cbca2198 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:33.820165 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e99af3a-36f6-4077-9048-9024cbca2198 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:33.820652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e99af3a-36f6-4077-9048-9024cbca2198 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:33.821080 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e99af3a-36f6-4077-9048-9024cbca2198 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:33.821661 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-8e99af3a-36f6-4077-9048-9024cbca2198 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lazy-loading 'fault' on Instance uuid fe593696-0213-453f-8fcb-ce9b0b0bcabd {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:20:33.869483 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8e99af3a-36f6-4077-9048-9024cbca2198 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb28ddd5511425a93c7b486d78a99eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba610aa04549c3ab792787257f4372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:33.882052 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8e99af3a-36f6-4077-9048-9024cbca2198 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 200 len: 1351 microversion: 2.1 time: 0.118258 Sep 05 12:20:33.883087 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 77/164] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:33 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:20:34.919114 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8215360d-8d5a-4363-b0bc-4183fa1491be tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:34.919916 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-8215360d-8d5a-4363-b0bc-4183fa1491be tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:34.926723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8215360d-8d5a-4363-b0bc-4183fa1491be tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:34.927211 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8215360d-8d5a-4363-b0bc-4183fa1491be tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:34.927688 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8215360d-8d5a-4363-b0bc-4183fa1491be tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:34.928399 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8215360d-8d5a-4363-b0bc-4183fa1491be tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:34.928862 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8215360d-8d5a-4363-b0bc-4183fa1491be tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:34.929288 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8215360d-8d5a-4363-b0bc-4183fa1491be tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:34.963511 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-8215360d-8d5a-4363-b0bc-4183fa1491be tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] HTTP exception thrown: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8215360d-8d5a-4363-b0bc-4183fa1491be tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Request method failure captured: Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd HTTP/1.1 Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFekyqokawPFFsbXnd__KsBhwJfoyBuYPTqoMIR-XZ2eehWpa7PltJcx9eMuxkKc703rMzlI2LsBsI67RKQdwuiZ2_xLWgYpQObBdn47TeCzSphyMxuelGTl6Ij8LlYjPAMUc7iGBDAur6ppWCXz9uETFMd39OjKTS_hMM3UYPg3hbeA Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 09ba610aa04549c3ab792787257f4372 Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-DeleteServersTestJSON-1193545074 Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:20:34.972860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:20:34.974304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09ba610aa04549c3ab792787257f4372", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09ba610aa04549c3ab792787257f4372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09ba610aa04549c3ab792787257f4372"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09ba610aa04549c3ab792787257f4372"}]}] Sep 05 12:20:34.974304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-DeleteServersTestJSON-1193545074 Sep 05 12:20:34.974304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 09ba610aa04549c3ab792787257f4372 Sep 05 12:20:34.974304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-DeleteServersTestJSON-1193545074 Sep 05 12:20:34.974304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-DeleteServersTestJSON-1193545074-project Sep 05 12:20:34.974304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:20:34.974304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:20:34.974304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 6fb28ddd5511425a93c7b486d78a99eb Sep 05 12:20:34.974304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-DeleteServersTestJSON-1193545074-project Sep 05 12:20:34.974304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:20:34.974304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:34.974304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': 'fe593696-0213-453f-8fcb-ce9b0b0bcabd'} Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:20:34.975172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:34.976594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:20:34.979771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8215360d-8d5a-4363-b0bc-4183fa1491be tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Returning 404 to user: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:20:34.979771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8215360d-8d5a-4363-b0bc-4183fa1491be tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 404 len: 111 microversion: 2.1 time: 0.062074 Sep 05 12:20:34.989945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 88/165] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:34 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:20:35.111305 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f62497ca-aa69-490d-9bb0-5dd01a6102d0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:35.113499 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f62497ca-aa69-490d-9bb0-5dd01a6102d0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:35.122552 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f62497ca-aa69-490d-9bb0-5dd01a6102d0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:35.123052 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f62497ca-aa69-490d-9bb0-5dd01a6102d0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:35.123492 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f62497ca-aa69-490d-9bb0-5dd01a6102d0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:35.124236 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f62497ca-aa69-490d-9bb0-5dd01a6102d0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:35.124694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f62497ca-aa69-490d-9bb0-5dd01a6102d0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:35.125172 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f62497ca-aa69-490d-9bb0-5dd01a6102d0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:35.138401 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-f62497ca-aa69-490d-9bb0-5dd01a6102d0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] HTTP exception thrown: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f62497ca-aa69-490d-9bb0-5dd01a6102d0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Request method failure captured: Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd/os-volume_attachments HTTP/1.1 Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFekyqokawPFFsbXnd__KsBhwJfoyBuYPTqoMIR-XZ2eehWpa7PltJcx9eMuxkKc703rMzlI2LsBsI67RKQdwuiZ2_xLWgYpQObBdn47TeCzSphyMxuelGTl6Ij8LlYjPAMUc7iGBDAur6ppWCXz9uETFMd39OjKTS_hMM3UYPg3hbeA Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 09ba610aa04549c3ab792787257f4372 Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-DeleteServersTestJSON-1193545074 Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:20:35.142999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:20:35.144493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09ba610aa04549c3ab792787257f4372", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09ba610aa04549c3ab792787257f4372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09ba610aa04549c3ab792787257f4372"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09ba610aa04549c3ab792787257f4372"}]}] Sep 05 12:20:35.144493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-DeleteServersTestJSON-1193545074 Sep 05 12:20:35.144493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 09ba610aa04549c3ab792787257f4372 Sep 05 12:20:35.144493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1193545074 Sep 05 12:20:35.144493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-DeleteServersTestJSON-1193545074-project Sep 05 12:20:35.144493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:20:35.144493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:20:35.144493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: 6fb28ddd5511425a93c7b486d78a99eb Sep 05 12:20:35.144493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-DeleteServersTestJSON-1193545074-project Sep 05 12:20:35.144493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:20:35.144493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:35.144493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'server_id': 'fe593696-0213-453f-8fcb-ce9b0b0bcabd'} Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:20:35.145350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:35.146652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:20:35.148042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f62497ca-aa69-490d-9bb0-5dd01a6102d0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Returning 404 to user: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:20:35.148042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f62497ca-aa69-490d-9bb0-5dd01a6102d0 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037667 Sep 05 12:20:35.148042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 78/166] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:20:35 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:20:49.090940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-bbf3b5db-5bcd-48fb-b8df-c12acaa37724 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:49.091623 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-bbf3b5db-5bcd-48fb-b8df-c12acaa37724 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:49.093904 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=15 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:49.094581 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=49 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:49.105801 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bbf3b5db-5bcd-48fb-b8df-c12acaa37724 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:49.107399 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bbf3b5db-5bcd-48fb-b8df-c12acaa37724 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:49.108032 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bbf3b5db-5bcd-48fb-b8df-c12acaa37724 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:49.108918 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bbf3b5db-5bcd-48fb-b8df-c12acaa37724 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:49.109529 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bbf3b5db-5bcd-48fb-b8df-c12acaa37724 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:49.110130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bbf3b5db-5bcd-48fb-b8df-c12acaa37724 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:49.132401 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-bbf3b5db-5bcd-48fb-b8df-c12acaa37724 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] HTTP exception thrown: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-bbf3b5db-5bcd-48fb-b8df-c12acaa37724 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Request method failure captured: Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: DELETE /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd HTTP/1.1 Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFekyqokawPFFsbXnd__KsBhwJfoyBuYPTqoMIR-XZ2eehWpa7PltJcx9eMuxkKc703rMzlI2LsBsI67RKQdwuiZ2_xLWgYpQObBdn47TeCzSphyMxuelGTl6Ij8LlYjPAMUc7iGBDAur6ppWCXz9uETFMd39OjKTS_hMM3UYPg3hbeA Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 09ba610aa04549c3ab792787257f4372 Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-DeleteServersTestJSON-1193545074 Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:20:49.135645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:20:49.137237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09ba610aa04549c3ab792787257f4372", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09ba610aa04549c3ab792787257f4372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09ba610aa04549c3ab792787257f4372"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09ba610aa04549c3ab792787257f4372"}]}] Sep 05 12:20:49.137237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-DeleteServersTestJSON-1193545074 Sep 05 12:20:49.137237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 09ba610aa04549c3ab792787257f4372 Sep 05 12:20:49.137237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-DeleteServersTestJSON-1193545074 Sep 05 12:20:49.137237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-DeleteServersTestJSON-1193545074-project Sep 05 12:20:49.137237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:20:49.137237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:20:49.137237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 6fb28ddd5511425a93c7b486d78a99eb Sep 05 12:20:49.137237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-DeleteServersTestJSON-1193545074-project Sep 05 12:20:49.137237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:20:49.137237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:49.137237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': 'fe593696-0213-453f-8fcb-ce9b0b0bcabd'} Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:20:49.138116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:49.139782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:20:49.141622 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-bbf3b5db-5bcd-48fb-b8df-c12acaa37724 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Returning 404 to user: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:20:49.141622 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-bbf3b5db-5bcd-48fb-b8df-c12acaa37724 tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 404 len: 111 microversion: 2.1 time: 0.050649 Sep 05 12:20:49.141622 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 89/167] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:20:49 2022] DELETE /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:20:49.146101 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e9d23f32-b9e1-4f50-b280-1adb7821e32a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:49.147355 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e9d23f32-b9e1-4f50-b280-1adb7821e32a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] [instance: fe593696-0213-453f-8fcb-ce9b0b0bcabd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:49.150963 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=15 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:49.152068 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=17 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:49.158735 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9d23f32-b9e1-4f50-b280-1adb7821e32a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:49.159224 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9d23f32-b9e1-4f50-b280-1adb7821e32a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:49.159689 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9d23f32-b9e1-4f50-b280-1adb7821e32a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:49.160388 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9d23f32-b9e1-4f50-b280-1adb7821e32a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:49.160847 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9d23f32-b9e1-4f50-b280-1adb7821e32a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:49.161251 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9d23f32-b9e1-4f50-b280-1adb7821e32a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:49.176123 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-e9d23f32-b9e1-4f50-b280-1adb7821e32a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] HTTP exception thrown: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e9d23f32-b9e1-4f50-b280-1adb7821e32a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Request method failure captured: Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd HTTP/1.1 Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFekyqokawPFFsbXnd__KsBhwJfoyBuYPTqoMIR-XZ2eehWpa7PltJcx9eMuxkKc703rMzlI2LsBsI67RKQdwuiZ2_xLWgYpQObBdn47TeCzSphyMxuelGTl6Ij8LlYjPAMUc7iGBDAur6ppWCXz9uETFMd39OjKTS_hMM3UYPg3hbeA Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 09ba610aa04549c3ab792787257f4372 Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-DeleteServersTestJSON-1193545074 Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:20:49.178322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:20:49.179972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09ba610aa04549c3ab792787257f4372", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09ba610aa04549c3ab792787257f4372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09ba610aa04549c3ab792787257f4372"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09ba610aa04549c3ab792787257f4372"}]}] Sep 05 12:20:49.179972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-DeleteServersTestJSON-1193545074 Sep 05 12:20:49.179972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 09ba610aa04549c3ab792787257f4372 Sep 05 12:20:49.179972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1193545074 Sep 05 12:20:49.179972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-DeleteServersTestJSON-1193545074-project Sep 05 12:20:49.179972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:20:49.179972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:20:49.179972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: 6fb28ddd5511425a93c7b486d78a99eb Sep 05 12:20:49.179972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-DeleteServersTestJSON-1193545074-project Sep 05 12:20:49.179972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:20:49.179972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:49.179972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': 'fe593696-0213-453f-8fcb-ce9b0b0bcabd'} Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:20:49.180795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. Sep 05 12:20:49.181999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:20:49.182933 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e9d23f32-b9e1-4f50-b280-1adb7821e32a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] Returning 404 to user: Instance fe593696-0213-453f-8fcb-ce9b0b0bcabd could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:20:49.182933 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e9d23f32-b9e1-4f50-b280-1adb7821e32a tempest-DeleteServersTestJSON-1193545074 tempest-DeleteServersTestJSON-1193545074-project] 10.222.0.16 "GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd" status: 404 len: 111 microversion: 2.1 time: 0.038038 Sep 05 12:20:49.182933 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 79/168] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:49 2022] GET /compute/v2.1/servers/fe593696-0213-453f-8fcb-ce9b0b0bcabd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 12:20:59.142777 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:59.143554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:59.257861 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-670586649", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:20:59.322657 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.network.neutron [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] validate_networks() for [('9ba0f72a-39d7-48a3-9019-b84b5d6d00ba', None, None, None, None, None)] {{(pid=120534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:20:59.719765 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Flavor limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:20:59.720200 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Image limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:20:59.725410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Flavor pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:20:59.725906 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Image pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:20:59.726329 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:20:59.735357 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:59.735902 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:59.736400 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:59.737126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:59.737754 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:59.738185 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:59.767964 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Getting quotas for project 938f765828c545a8840a6983bc5d9e6d. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:20:59.772975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Getting quotas for user ff0999bd21bf4db5981053922200be2a and project 938f765828c545a8840a6983bc5d9e6d. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:20:59.786225 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Going to run 1 instances... {{(pid=120534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:20:59.788560 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:20:59.843836 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2da488e6-7a05-41a8-b53c-252dd7b0349a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.705857 Sep 05 12:20:59.844667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 90/169] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:20:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:20:59.856135 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f3b3d3f1-d8c4-445b-9016-109db20ad671 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:59.856852 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f3b3d3f1-d8c4-445b-9016-109db20ad671 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:20:59.859498 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:59.860316 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:59.935167 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f3b3d3f1-d8c4-445b-9016-109db20ad671 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:20:59.942402 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f3b3d3f1-d8c4-445b-9016-109db20ad671 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1221 microversion: 2.1 time: 0.089944 Sep 05 12:20:59.942982 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 80/170] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:20:59 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:00.012960 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1741187227", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:00.082268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.network.neutron [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] validate_networks() for [('9ba0f72a-39d7-48a3-9019-b84b5d6d00ba', None, None, None, None, None)] {{(pid=120534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:21:00.589818 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Flavor limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:21:00.592753 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Image limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:21:00.593552 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Flavor pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:21:00.594332 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Image pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:21:00.595100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:21:00.612481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:00.613209 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:00.614034 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:00.615394 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:00.622201 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:00.623167 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:00.659419 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Getting quotas for project 938f765828c545a8840a6983bc5d9e6d. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:21:00.666166 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Getting quotas for user ff0999bd21bf4db5981053922200be2a and project 938f765828c545a8840a6983bc5d9e6d. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:21:00.700251 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Going to run 1 instances... {{(pid=120534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:21:00.704580 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:21:00.774622 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a57997ed-470e-4c00-ac54-1155bd13fbc6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.768726 Sep 05 12:21:00.775656 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 91/171] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:21:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:21:00.787312 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5ec2ed7e-9d4f-4e6e-8c03-b05bc1577645 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:00.788250 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5ec2ed7e-9d4f-4e6e-8c03-b05bc1577645 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:01.115639 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5ec2ed7e-9d4f-4e6e-8c03-b05bc1577645 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:01.125050 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5ec2ed7e-9d4f-4e6e-8c03-b05bc1577645 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1222 microversion: 2.1 time: 0.342109 Sep 05 12:21:01.126380 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 81/172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:00 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1222 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:02.147863 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c3e2bfc6-ee53-4e3d-8d35-bfa878d3294d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:02.148765 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c3e2bfc6-ee53-4e3d-8d35-bfa878d3294d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:02.157620 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c3e2bfc6-ee53-4e3d-8d35-bfa878d3294d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:02.158138 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c3e2bfc6-ee53-4e3d-8d35-bfa878d3294d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:02.158595 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c3e2bfc6-ee53-4e3d-8d35-bfa878d3294d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:02.159363 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c3e2bfc6-ee53-4e3d-8d35-bfa878d3294d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:02.159859 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c3e2bfc6-ee53-4e3d-8d35-bfa878d3294d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:02.160310 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c3e2bfc6-ee53-4e3d-8d35-bfa878d3294d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:02.226439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c3e2bfc6-ee53-4e3d-8d35-bfa878d3294d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:02.235383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c3e2bfc6-ee53-4e3d-8d35-bfa878d3294d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1226 microversion: 2.1 time: 0.091433 Sep 05 12:21:02.236767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 92/173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:02 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:03.258789 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6e5a0796-4e15-4c0b-a1dd-d9cf3b1d2ab1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:03.259542 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6e5a0796-4e15-4c0b-a1dd-d9cf3b1d2ab1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:03.266235 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6e5a0796-4e15-4c0b-a1dd-d9cf3b1d2ab1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:03.266712 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6e5a0796-4e15-4c0b-a1dd-d9cf3b1d2ab1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:03.267156 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6e5a0796-4e15-4c0b-a1dd-d9cf3b1d2ab1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:03.268392 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6e5a0796-4e15-4c0b-a1dd-d9cf3b1d2ab1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:03.268838 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6e5a0796-4e15-4c0b-a1dd-d9cf3b1d2ab1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:03.269423 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6e5a0796-4e15-4c0b-a1dd-d9cf3b1d2ab1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:03.334015 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6e5a0796-4e15-4c0b-a1dd-d9cf3b1d2ab1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:03.343477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6e5a0796-4e15-4c0b-a1dd-d9cf3b1d2ab1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1226 microversion: 2.1 time: 0.088564 Sep 05 12:21:03.344097 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 82/174] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:03 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:04.365972 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b7cb9d12-9832-4bbf-b613-1f7058517fa3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:04.367103 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b7cb9d12-9832-4bbf-b613-1f7058517fa3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:04.377507 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b7cb9d12-9832-4bbf-b613-1f7058517fa3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:04.378120 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b7cb9d12-9832-4bbf-b613-1f7058517fa3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:04.378642 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b7cb9d12-9832-4bbf-b613-1f7058517fa3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:04.379434 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b7cb9d12-9832-4bbf-b613-1f7058517fa3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:04.380072 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b7cb9d12-9832-4bbf-b613-1f7058517fa3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:04.380641 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b7cb9d12-9832-4bbf-b613-1f7058517fa3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:04.442141 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b7cb9d12-9832-4bbf-b613-1f7058517fa3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:04.450807 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b7cb9d12-9832-4bbf-b613-1f7058517fa3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1226 microversion: 2.1 time: 0.088582 Sep 05 12:21:04.451375 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 93/175] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:04 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:05.473608 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6160672f-9601-4381-a768-0909e594a48a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:05.474213 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6160672f-9601-4381-a768-0909e594a48a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:05.482660 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6160672f-9601-4381-a768-0909e594a48a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:05.483142 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6160672f-9601-4381-a768-0909e594a48a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:05.483598 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6160672f-9601-4381-a768-0909e594a48a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:05.484558 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6160672f-9601-4381-a768-0909e594a48a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:05.485152 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6160672f-9601-4381-a768-0909e594a48a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:05.485726 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6160672f-9601-4381-a768-0909e594a48a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:05.554785 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6160672f-9601-4381-a768-0909e594a48a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:05.563138 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6160672f-9601-4381-a768-0909e594a48a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1218 microversion: 2.1 time: 0.093362 Sep 05 12:21:05.563753 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 83/176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:05 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:06.588359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b26d5076-002d-433f-bc17-796b014e4b10 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:06.590190 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b26d5076-002d-433f-bc17-796b014e4b10 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:06.602226 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b26d5076-002d-433f-bc17-796b014e4b10 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:06.602949 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b26d5076-002d-433f-bc17-796b014e4b10 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:06.603388 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b26d5076-002d-433f-bc17-796b014e4b10 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:06.604222 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b26d5076-002d-433f-bc17-796b014e4b10 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:06.604842 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b26d5076-002d-433f-bc17-796b014e4b10 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:06.605270 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b26d5076-002d-433f-bc17-796b014e4b10 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:06.703307 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b26d5076-002d-433f-bc17-796b014e4b10 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:06.712565 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b26d5076-002d-433f-bc17-796b014e4b10 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1274 microversion: 2.1 time: 0.129378 Sep 05 12:21:06.713139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 94/177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:06 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1274 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:07.744530 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ad276611-5668-42f4-9594-65e77ed53814 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:07.751069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ad276611-5668-42f4-9594-65e77ed53814 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:07.774099 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ad276611-5668-42f4-9594-65e77ed53814 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:07.774860 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ad276611-5668-42f4-9594-65e77ed53814 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:07.775301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ad276611-5668-42f4-9594-65e77ed53814 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:07.778670 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ad276611-5668-42f4-9594-65e77ed53814 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:07.780649 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ad276611-5668-42f4-9594-65e77ed53814 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:07.781179 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ad276611-5668-42f4-9594-65e77ed53814 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:08.063271 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ad276611-5668-42f4-9594-65e77ed53814 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:08.072224 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ad276611-5668-42f4-9594-65e77ed53814 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.337818 Sep 05 12:21:08.073109 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 84/178] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:07 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:08.166299 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-aa0d340e-54e6-42ee-9474-3af3d9458fec req-4d22554e-f09b-4799-bf85-fc16ab00931d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d0f215-d209-4143-924d-85e2b10edd9e", "tag": "9674c5b2-c4af-437f-9c8d-565f5537d90b"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:08.176404 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-aa0d340e-54e6-42ee-9474-3af3d9458fec req-4d22554e-f09b-4799-bf85-fc16ab00931d service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:08.176881 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-aa0d340e-54e6-42ee-9474-3af3d9458fec req-4d22554e-f09b-4799-bf85-fc16ab00931d service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:08.177309 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-aa0d340e-54e6-42ee-9474-3af3d9458fec req-4d22554e-f09b-4799-bf85-fc16ab00931d service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:08.188326 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-aa0d340e-54e6-42ee-9474-3af3d9458fec req-4d22554e-f09b-4799-bf85-fc16ab00931d service nova] Creating event network-changed:9674c5b2-c4af-437f-9c8d-565f5537d90b for instance 98d0f215-d209-4143-924d-85e2b10edd9e on hv-cinder-85518 Sep 05 12:21:08.194030 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-aa0d340e-54e6-42ee-9474-3af3d9458fec req-4d22554e-f09b-4799-bf85-fc16ab00931d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031930 Sep 05 12:21:08.194767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 95/179] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:21:09.094724 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0b1a78aa-12e3-4302-a822-e7f0244e3af4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:09.095332 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0b1a78aa-12e3-4302-a822-e7f0244e3af4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:09.101862 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b1a78aa-12e3-4302-a822-e7f0244e3af4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:09.102346 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b1a78aa-12e3-4302-a822-e7f0244e3af4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:09.102783 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b1a78aa-12e3-4302-a822-e7f0244e3af4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:09.103475 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b1a78aa-12e3-4302-a822-e7f0244e3af4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:09.103955 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b1a78aa-12e3-4302-a822-e7f0244e3af4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:09.104382 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b1a78aa-12e3-4302-a822-e7f0244e3af4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:09.232070 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0b1a78aa-12e3-4302-a822-e7f0244e3af4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:09.240304 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0b1a78aa-12e3-4302-a822-e7f0244e3af4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.149370 Sep 05 12:21:09.240869 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 85/180] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:09 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:10.264043 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a9ea42ad-e5a9-4cd2-a9cc-40a7a5a62c93 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:10.264725 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a9ea42ad-e5a9-4cd2-a9cc-40a7a5a62c93 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:10.271380 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a9ea42ad-e5a9-4cd2-a9cc-40a7a5a62c93 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:10.271894 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a9ea42ad-e5a9-4cd2-a9cc-40a7a5a62c93 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:10.272336 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a9ea42ad-e5a9-4cd2-a9cc-40a7a5a62c93 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:10.273034 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a9ea42ad-e5a9-4cd2-a9cc-40a7a5a62c93 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:10.273515 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a9ea42ad-e5a9-4cd2-a9cc-40a7a5a62c93 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:10.273958 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a9ea42ad-e5a9-4cd2-a9cc-40a7a5a62c93 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:10.413043 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a9ea42ad-e5a9-4cd2-a9cc-40a7a5a62c93 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:10.421231 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a9ea42ad-e5a9-4cd2-a9cc-40a7a5a62c93 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.161498 Sep 05 12:21:10.422062 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 96/181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:10 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:11.445161 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-3f956366-671f-4636-a395-9e8e0553c317 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:11.446014 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3f956366-671f-4636-a395-9e8e0553c317 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:11.448723 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=4 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:11.454224 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3f956366-671f-4636-a395-9e8e0553c317 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:11.455177 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3f956366-671f-4636-a395-9e8e0553c317 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:11.455853 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3f956366-671f-4636-a395-9e8e0553c317 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:11.456565 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3f956366-671f-4636-a395-9e8e0553c317 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:11.457024 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3f956366-671f-4636-a395-9e8e0553c317 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:11.457510 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3f956366-671f-4636-a395-9e8e0553c317 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:11.760627 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-3f956366-671f-4636-a395-9e8e0553c317 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:11.779944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-3f956366-671f-4636-a395-9e8e0553c317 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.338803 Sep 05 12:21:11.796729 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 86/182] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:11 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:12.210407 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-d1b5f738-f195-49bc-b6be-d97aff26c201 req-67bbfd2e-d934-4de2-9b4a-7b07230336d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d72a6ee-e4bf-4eca-afd2-0047a95d57a5", "tag": "7ec54931-635e-4001-b648-0b385ff9376b"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:12.216480 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=4 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:12.217146 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=12 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:12.228190 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-d1b5f738-f195-49bc-b6be-d97aff26c201 req-67bbfd2e-d934-4de2-9b4a-7b07230336d6 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:12.228863 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-d1b5f738-f195-49bc-b6be-d97aff26c201 req-67bbfd2e-d934-4de2-9b4a-7b07230336d6 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:12.229300 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-d1b5f738-f195-49bc-b6be-d97aff26c201 req-67bbfd2e-d934-4de2-9b4a-7b07230336d6 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:12.252314 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-d1b5f738-f195-49bc-b6be-d97aff26c201 req-67bbfd2e-d934-4de2-9b4a-7b07230336d6 service nova] Creating event network-changed:7ec54931-635e-4001-b648-0b385ff9376b for instance 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 on hv-cinder-85518 Sep 05 12:21:12.257369 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-d1b5f738-f195-49bc-b6be-d97aff26c201 req-67bbfd2e-d934-4de2-9b4a-7b07230336d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050731 Sep 05 12:21:12.258472 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 97/183] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:21:12.804454 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-fe09efde-a905-4541-8a6f-1fdb5efc4cfc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:12.805493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-fe09efde-a905-4541-8a6f-1fdb5efc4cfc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:12.812039 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fe09efde-a905-4541-8a6f-1fdb5efc4cfc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:12.812604 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fe09efde-a905-4541-8a6f-1fdb5efc4cfc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:12.813119 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fe09efde-a905-4541-8a6f-1fdb5efc4cfc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:12.813893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fe09efde-a905-4541-8a6f-1fdb5efc4cfc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:12.814429 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fe09efde-a905-4541-8a6f-1fdb5efc4cfc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:12.815004 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fe09efde-a905-4541-8a6f-1fdb5efc4cfc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:12.952208 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-fe09efde-a905-4541-8a6f-1fdb5efc4cfc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:12.960073 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-fe09efde-a905-4541-8a6f-1fdb5efc4cfc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.159403 Sep 05 12:21:12.960549 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 87/184] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:12 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:13.984044 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-348bfe35-c8c0-4ee5-b783-2cf2d20d8c23 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:13.984738 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-348bfe35-c8c0-4ee5-b783-2cf2d20d8c23 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:13.991365 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-348bfe35-c8c0-4ee5-b783-2cf2d20d8c23 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:13.991874 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-348bfe35-c8c0-4ee5-b783-2cf2d20d8c23 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:13.992308 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-348bfe35-c8c0-4ee5-b783-2cf2d20d8c23 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:13.993185 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-348bfe35-c8c0-4ee5-b783-2cf2d20d8c23 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:13.993633 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-348bfe35-c8c0-4ee5-b783-2cf2d20d8c23 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:13.994058 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-348bfe35-c8c0-4ee5-b783-2cf2d20d8c23 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:14.139545 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-348bfe35-c8c0-4ee5-b783-2cf2d20d8c23 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:14.147705 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-348bfe35-c8c0-4ee5-b783-2cf2d20d8c23 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.167752 Sep 05 12:21:14.148278 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 98/185] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:13 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:15.174028 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d2178380-b89b-4587-a0fb-a32dc2c61832 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:15.174637 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d2178380-b89b-4587-a0fb-a32dc2c61832 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:15.180861 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2178380-b89b-4587-a0fb-a32dc2c61832 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:15.181340 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2178380-b89b-4587-a0fb-a32dc2c61832 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:15.181769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2178380-b89b-4587-a0fb-a32dc2c61832 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:15.182450 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2178380-b89b-4587-a0fb-a32dc2c61832 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:15.182900 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2178380-b89b-4587-a0fb-a32dc2c61832 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:15.183326 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2178380-b89b-4587-a0fb-a32dc2c61832 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:15.310545 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d2178380-b89b-4587-a0fb-a32dc2c61832 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:15.318805 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d2178380-b89b-4587-a0fb-a32dc2c61832 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.148633 Sep 05 12:21:15.319372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 88/186] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:15 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:16.341668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4055db8e-5382-461a-953b-6b51347c6162 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:16.342200 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4055db8e-5382-461a-953b-6b51347c6162 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:16.348993 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4055db8e-5382-461a-953b-6b51347c6162 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:16.349475 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4055db8e-5382-461a-953b-6b51347c6162 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:16.349913 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4055db8e-5382-461a-953b-6b51347c6162 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:16.350609 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4055db8e-5382-461a-953b-6b51347c6162 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:16.351068 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4055db8e-5382-461a-953b-6b51347c6162 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:16.351495 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4055db8e-5382-461a-953b-6b51347c6162 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:16.478501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4055db8e-5382-461a-953b-6b51347c6162 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:16.486267 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4055db8e-5382-461a-953b-6b51347c6162 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.148620 Sep 05 12:21:16.486832 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 99/187] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:16 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:17.509016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7c34d2ba-7eac-4752-99d0-3d1a2aad4944 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:17.509698 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7c34d2ba-7eac-4752-99d0-3d1a2aad4944 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:17.516231 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7c34d2ba-7eac-4752-99d0-3d1a2aad4944 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:17.516791 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7c34d2ba-7eac-4752-99d0-3d1a2aad4944 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:17.517323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7c34d2ba-7eac-4752-99d0-3d1a2aad4944 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:17.518628 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7c34d2ba-7eac-4752-99d0-3d1a2aad4944 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:17.519152 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7c34d2ba-7eac-4752-99d0-3d1a2aad4944 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:17.519690 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7c34d2ba-7eac-4752-99d0-3d1a2aad4944 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:17.652772 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-7c34d2ba-7eac-4752-99d0-3d1a2aad4944 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:17.660551 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7c34d2ba-7eac-4752-99d0-3d1a2aad4944 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.155473 Sep 05 12:21:17.661153 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 89/188] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:17 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:18.683477 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7a52aba7-c6ac-4015-9cdd-4174cab0475d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:18.684255 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7a52aba7-c6ac-4015-9cdd-4174cab0475d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:18.690708 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7a52aba7-c6ac-4015-9cdd-4174cab0475d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:18.691193 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7a52aba7-c6ac-4015-9cdd-4174cab0475d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:18.691665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7a52aba7-c6ac-4015-9cdd-4174cab0475d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:18.692357 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7a52aba7-c6ac-4015-9cdd-4174cab0475d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:18.692813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7a52aba7-c6ac-4015-9cdd-4174cab0475d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:18.693235 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7a52aba7-c6ac-4015-9cdd-4174cab0475d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:18.832578 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7a52aba7-c6ac-4015-9cdd-4174cab0475d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:18.840422 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7a52aba7-c6ac-4015-9cdd-4174cab0475d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.161222 Sep 05 12:21:18.840984 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 100/189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:18 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:19.863843 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-47ec107f-5ba5-4863-a073-34e339a743fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:19.864484 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-47ec107f-5ba5-4863-a073-34e339a743fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:19.870982 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-47ec107f-5ba5-4863-a073-34e339a743fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:19.871465 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-47ec107f-5ba5-4863-a073-34e339a743fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:19.871959 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-47ec107f-5ba5-4863-a073-34e339a743fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:19.872644 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-47ec107f-5ba5-4863-a073-34e339a743fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:19.873099 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-47ec107f-5ba5-4863-a073-34e339a743fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:19.873525 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-47ec107f-5ba5-4863-a073-34e339a743fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:19.999237 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-47ec107f-5ba5-4863-a073-34e339a743fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:20.007428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-47ec107f-5ba5-4863-a073-34e339a743fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.147929 Sep 05 12:21:20.008026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 90/190] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:19 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:21.030280 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-13a0e86d-aaa3-4a50-a0e5-897cdc906427 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:21.030887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-13a0e86d-aaa3-4a50-a0e5-897cdc906427 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:21.037364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-13a0e86d-aaa3-4a50-a0e5-897cdc906427 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:21.037855 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-13a0e86d-aaa3-4a50-a0e5-897cdc906427 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:21.038293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-13a0e86d-aaa3-4a50-a0e5-897cdc906427 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:21.039014 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-13a0e86d-aaa3-4a50-a0e5-897cdc906427 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:21.039483 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-13a0e86d-aaa3-4a50-a0e5-897cdc906427 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:21.039930 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-13a0e86d-aaa3-4a50-a0e5-897cdc906427 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:21.173624 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-13a0e86d-aaa3-4a50-a0e5-897cdc906427 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:21.181342 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-13a0e86d-aaa3-4a50-a0e5-897cdc906427 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.154885 Sep 05 12:21:21.181908 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 101/191] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:21 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:22.204097 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e338417b-999d-4bd9-81bb-a07024dd6295 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:22.204630 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e338417b-999d-4bd9-81bb-a07024dd6295 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:22.211557 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e338417b-999d-4bd9-81bb-a07024dd6295 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:22.212044 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e338417b-999d-4bd9-81bb-a07024dd6295 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:22.212482 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e338417b-999d-4bd9-81bb-a07024dd6295 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:22.213219 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e338417b-999d-4bd9-81bb-a07024dd6295 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:22.213676 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e338417b-999d-4bd9-81bb-a07024dd6295 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:22.214101 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e338417b-999d-4bd9-81bb-a07024dd6295 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:22.380124 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e338417b-999d-4bd9-81bb-a07024dd6295 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:22.388313 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e338417b-999d-4bd9-81bb-a07024dd6295 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.187994 Sep 05 12:21:22.389305 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 91/192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:22 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:23.413015 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9e0f39e7-9b4f-4715-88eb-2f9b83113dc2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:23.413774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9e0f39e7-9b4f-4715-88eb-2f9b83113dc2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:23.420057 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9e0f39e7-9b4f-4715-88eb-2f9b83113dc2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:23.420783 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9e0f39e7-9b4f-4715-88eb-2f9b83113dc2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:23.421445 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9e0f39e7-9b4f-4715-88eb-2f9b83113dc2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:23.422154 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9e0f39e7-9b4f-4715-88eb-2f9b83113dc2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:23.422620 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9e0f39e7-9b4f-4715-88eb-2f9b83113dc2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:23.423243 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9e0f39e7-9b4f-4715-88eb-2f9b83113dc2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:23.565245 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9e0f39e7-9b4f-4715-88eb-2f9b83113dc2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:23.573017 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9e0f39e7-9b4f-4715-88eb-2f9b83113dc2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.163907 Sep 05 12:21:23.573577 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 102/193] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:23 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:24.596682 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f186a29d-1734-4e31-aa9d-815ba5e224d7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:24.597552 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f186a29d-1734-4e31-aa9d-815ba5e224d7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:24.605562 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f186a29d-1734-4e31-aa9d-815ba5e224d7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:24.606048 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f186a29d-1734-4e31-aa9d-815ba5e224d7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:24.606470 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f186a29d-1734-4e31-aa9d-815ba5e224d7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:24.607169 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f186a29d-1734-4e31-aa9d-815ba5e224d7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:24.607693 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f186a29d-1734-4e31-aa9d-815ba5e224d7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:24.608267 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f186a29d-1734-4e31-aa9d-815ba5e224d7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:24.769157 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f186a29d-1734-4e31-aa9d-815ba5e224d7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:24.774175 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-2bb9c68c-51cd-4d24-8052-6dfbf6b10fd5 req-79284dc1-63dc-4c70-9d88-3a7ff405d6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d0f215-d209-4143-924d-85e2b10edd9e", "name": "network-vif-plugged", "status": "completed", "tag": "9674c5b2-c4af-437f-9c8d-565f5537d90b"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:24.790406 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f186a29d-1734-4e31-aa9d-815ba5e224d7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.198097 Sep 05 12:21:24.808663 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 92/194] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:24 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:24.812494 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-2bb9c68c-51cd-4d24-8052-6dfbf6b10fd5 req-79284dc1-63dc-4c70-9d88-3a7ff405d6c2 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:24.813228 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-2bb9c68c-51cd-4d24-8052-6dfbf6b10fd5 req-79284dc1-63dc-4c70-9d88-3a7ff405d6c2 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:24.813870 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-2bb9c68c-51cd-4d24-8052-6dfbf6b10fd5 req-79284dc1-63dc-4c70-9d88-3a7ff405d6c2 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:24.842700 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-2bb9c68c-51cd-4d24-8052-6dfbf6b10fd5 req-79284dc1-63dc-4c70-9d88-3a7ff405d6c2 service nova] Creating event network-vif-plugged:9674c5b2-c4af-437f-9c8d-565f5537d90b for instance 98d0f215-d209-4143-924d-85e2b10edd9e on hv-cinder-85518 Sep 05 12:21:24.858739 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-2bb9c68c-51cd-4d24-8052-6dfbf6b10fd5 req-79284dc1-63dc-4c70-9d88-3a7ff405d6c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092954 Sep 05 12:21:24.859351 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 103/195] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:21:25.818800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2972f447-6f17-4cbd-bdae-03a784633fbf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:25.819404 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2972f447-6f17-4cbd-bdae-03a784633fbf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:25.826182 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2972f447-6f17-4cbd-bdae-03a784633fbf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:25.826667 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2972f447-6f17-4cbd-bdae-03a784633fbf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:25.827097 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2972f447-6f17-4cbd-bdae-03a784633fbf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:25.827920 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2972f447-6f17-4cbd-bdae-03a784633fbf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:25.828272 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2972f447-6f17-4cbd-bdae-03a784633fbf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:25.828723 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2972f447-6f17-4cbd-bdae-03a784633fbf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:25.977118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2972f447-6f17-4cbd-bdae-03a784633fbf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:25.986777 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2972f447-6f17-4cbd-bdae-03a784633fbf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.171457 Sep 05 12:21:25.988385 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 93/196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:25 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:27.022806 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8ea5d217-e717-4c22-94ff-d2dd35926af7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:27.023861 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-8ea5d217-e717-4c22-94ff-d2dd35926af7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:27.031469 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8ea5d217-e717-4c22-94ff-d2dd35926af7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:27.031999 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8ea5d217-e717-4c22-94ff-d2dd35926af7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:27.032444 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8ea5d217-e717-4c22-94ff-d2dd35926af7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:27.034050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8ea5d217-e717-4c22-94ff-d2dd35926af7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:27.034573 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8ea5d217-e717-4c22-94ff-d2dd35926af7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:27.034998 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8ea5d217-e717-4c22-94ff-d2dd35926af7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:27.280635 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8ea5d217-e717-4c22-94ff-d2dd35926af7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:27.289403 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8ea5d217-e717-4c22-94ff-d2dd35926af7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.271870 Sep 05 12:21:27.289970 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 104/197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:27 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:28.322552 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-196ce485-d697-41e6-a49f-acd3196576f3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:28.324427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-196ce485-d697-41e6-a49f-acd3196576f3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:28.353560 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-196ce485-d697-41e6-a49f-acd3196576f3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:28.357075 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-196ce485-d697-41e6-a49f-acd3196576f3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:28.357557 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-196ce485-d697-41e6-a49f-acd3196576f3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:28.358301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-196ce485-d697-41e6-a49f-acd3196576f3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:28.358881 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-196ce485-d697-41e6-a49f-acd3196576f3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:28.359355 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-196ce485-d697-41e6-a49f-acd3196576f3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:28.552078 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-196ce485-d697-41e6-a49f-acd3196576f3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:28.562665 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-196ce485-d697-41e6-a49f-acd3196576f3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.251594 Sep 05 12:21:28.575604 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 94/198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:28 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:28.787994 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-a03f53b3-3b08-47ae-a47f-e159f1ec76a0 req-447972ee-027b-4026-b989-2bed0a13a92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d72a6ee-e4bf-4eca-afd2-0047a95d57a5", "name": "network-vif-plugged", "status": "completed", "tag": "7ec54931-635e-4001-b648-0b385ff9376b"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:28.807621 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a03f53b3-3b08-47ae-a47f-e159f1ec76a0 req-447972ee-027b-4026-b989-2bed0a13a92f service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:28.808626 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a03f53b3-3b08-47ae-a47f-e159f1ec76a0 req-447972ee-027b-4026-b989-2bed0a13a92f service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:28.809402 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a03f53b3-3b08-47ae-a47f-e159f1ec76a0 req-447972ee-027b-4026-b989-2bed0a13a92f service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:28.828675 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-a03f53b3-3b08-47ae-a47f-e159f1ec76a0 req-447972ee-027b-4026-b989-2bed0a13a92f service nova] Creating event network-vif-plugged:7ec54931-635e-4001-b648-0b385ff9376b for instance 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 on hv-cinder-85518 Sep 05 12:21:28.836420 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-a03f53b3-3b08-47ae-a47f-e159f1ec76a0 req-447972ee-027b-4026-b989-2bed0a13a92f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051896 Sep 05 12:21:28.837436 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 105/199] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:21:29.600054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0eaede6a-d198-45bd-8efa-3b5f98a49269 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:29.601442 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0eaede6a-d198-45bd-8efa-3b5f98a49269 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:29.620537 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0eaede6a-d198-45bd-8efa-3b5f98a49269 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:29.623383 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0eaede6a-d198-45bd-8efa-3b5f98a49269 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:29.624022 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0eaede6a-d198-45bd-8efa-3b5f98a49269 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:29.624903 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0eaede6a-d198-45bd-8efa-3b5f98a49269 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:29.625518 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0eaede6a-d198-45bd-8efa-3b5f98a49269 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:29.626113 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0eaede6a-d198-45bd-8efa-3b5f98a49269 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:29.825424 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0eaede6a-d198-45bd-8efa-3b5f98a49269 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:29.835750 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0eaede6a-d198-45bd-8efa-3b5f98a49269 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.242102 Sep 05 12:21:29.836750 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 95/200] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:29 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:30.858832 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-31117c7d-67a8-426a-a597-08315f6ce671 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:30.859697 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-31117c7d-67a8-426a-a597-08315f6ce671 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:30.862945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:30.869427 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-31117c7d-67a8-426a-a597-08315f6ce671 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:30.870050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-31117c7d-67a8-426a-a597-08315f6ce671 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:30.870980 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-31117c7d-67a8-426a-a597-08315f6ce671 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:30.872020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-31117c7d-67a8-426a-a597-08315f6ce671 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:30.873022 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-31117c7d-67a8-426a-a597-08315f6ce671 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:30.873700 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-31117c7d-67a8-426a-a597-08315f6ce671 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:30.881676 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=73 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:31.074260 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-31117c7d-67a8-426a-a597-08315f6ce671 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:31.084318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-31117c7d-67a8-426a-a597-08315f6ce671 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.229812 Sep 05 12:21:31.084908 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 106/201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:30 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:32.111089 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-cf4aae11-97b2-4a5a-bc6f-ba29044bd28c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:32.112498 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-cf4aae11-97b2-4a5a-bc6f-ba29044bd28c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:32.119210 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=37 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:32.120945 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cf4aae11-97b2-4a5a-bc6f-ba29044bd28c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:32.121718 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cf4aae11-97b2-4a5a-bc6f-ba29044bd28c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:32.122268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cf4aae11-97b2-4a5a-bc6f-ba29044bd28c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:32.123637 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cf4aae11-97b2-4a5a-bc6f-ba29044bd28c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:32.124560 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cf4aae11-97b2-4a5a-bc6f-ba29044bd28c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:32.125219 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cf4aae11-97b2-4a5a-bc6f-ba29044bd28c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:32.131366 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=85 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:32.306143 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-cf4aae11-97b2-4a5a-bc6f-ba29044bd28c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:32.318569 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-cf4aae11-97b2-4a5a-bc6f-ba29044bd28c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.210737 Sep 05 12:21:32.321091 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 96/202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:32 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:33.343979 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4ae38f76-c423-4ea2-8e96-a5e741c56bfa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:33.344557 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4ae38f76-c423-4ea2-8e96-a5e741c56bfa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:33.350713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4ae38f76-c423-4ea2-8e96-a5e741c56bfa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:33.351198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4ae38f76-c423-4ea2-8e96-a5e741c56bfa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:33.351662 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4ae38f76-c423-4ea2-8e96-a5e741c56bfa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:33.352386 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4ae38f76-c423-4ea2-8e96-a5e741c56bfa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:33.352819 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4ae38f76-c423-4ea2-8e96-a5e741c56bfa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:33.353245 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4ae38f76-c423-4ea2-8e96-a5e741c56bfa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:33.481976 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4ae38f76-c423-4ea2-8e96-a5e741c56bfa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:33.492010 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4ae38f76-c423-4ea2-8e96-a5e741c56bfa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.151862 Sep 05 12:21:33.492587 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 107/203] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:33 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:34.514400 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7df3eb6a-4b01-4387-befd-8afed6f1da9e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:34.515000 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7df3eb6a-4b01-4387-befd-8afed6f1da9e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:34.522067 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7df3eb6a-4b01-4387-befd-8afed6f1da9e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:34.522545 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7df3eb6a-4b01-4387-befd-8afed6f1da9e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:34.522973 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7df3eb6a-4b01-4387-befd-8afed6f1da9e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:34.523688 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7df3eb6a-4b01-4387-befd-8afed6f1da9e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:34.524150 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7df3eb6a-4b01-4387-befd-8afed6f1da9e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:34.524811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7df3eb6a-4b01-4387-befd-8afed6f1da9e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:34.665501 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-7df3eb6a-4b01-4387-befd-8afed6f1da9e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:34.675756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7df3eb6a-4b01-4387-befd-8afed6f1da9e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1322 microversion: 2.1 time: 0.165220 Sep 05 12:21:34.676374 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 97/204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:34 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:35.702487 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e899e76e-8873-44da-90a4-075fc5001ca2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:35.704055 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e899e76e-8873-44da-90a4-075fc5001ca2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:35.715830 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e899e76e-8873-44da-90a4-075fc5001ca2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:35.716733 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e899e76e-8873-44da-90a4-075fc5001ca2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:35.717527 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e899e76e-8873-44da-90a4-075fc5001ca2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:35.718801 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e899e76e-8873-44da-90a4-075fc5001ca2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:35.719684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e899e76e-8873-44da-90a4-075fc5001ca2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:35.720483 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e899e76e-8873-44da-90a4-075fc5001ca2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:35.882082 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e899e76e-8873-44da-90a4-075fc5001ca2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:35.902923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e899e76e-8873-44da-90a4-075fc5001ca2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1515 microversion: 2.1 time: 0.207517 Sep 05 12:21:35.915737 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 108/205] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:35 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:35.929509 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-615e0b2d-bd28-4758-b0f0-7ec16e98abe1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:35.934060 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-615e0b2d-bd28-4758-b0f0-7ec16e98abe1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:35.943585 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-615e0b2d-bd28-4758-b0f0-7ec16e98abe1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:35.943585 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-615e0b2d-bd28-4758-b0f0-7ec16e98abe1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:35.943585 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-615e0b2d-bd28-4758-b0f0-7ec16e98abe1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:35.943585 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-615e0b2d-bd28-4758-b0f0-7ec16e98abe1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:35.944051 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-615e0b2d-bd28-4758-b0f0-7ec16e98abe1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:35.944051 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-615e0b2d-bd28-4758-b0f0-7ec16e98abe1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:35.969826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-615e0b2d-bd28-4758-b0f0-7ec16e98abe1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lazy-loading 'flavor' on Instance uuid 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:21:36.108166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-615e0b2d-bd28-4758-b0f0-7ec16e98abe1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "POST /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5/action" status: 200 len: 32 microversion: 2.1 time: 0.183710 Sep 05 12:21:36.108781 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 98/206] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Sep 5 12:21:35 2022] POST /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:21:36.118923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1a7e9e1e-699b-4981-aecb-58ed77ef0ae0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:36.119589 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1a7e9e1e-699b-4981-aecb-58ed77ef0ae0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:36.125892 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1a7e9e1e-699b-4981-aecb-58ed77ef0ae0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:36.126387 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1a7e9e1e-699b-4981-aecb-58ed77ef0ae0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:36.127759 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1a7e9e1e-699b-4981-aecb-58ed77ef0ae0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:36.128709 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1a7e9e1e-699b-4981-aecb-58ed77ef0ae0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:36.129431 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1a7e9e1e-699b-4981-aecb-58ed77ef0ae0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:36.130084 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1a7e9e1e-699b-4981-aecb-58ed77ef0ae0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:36.346672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1a7e9e1e-699b-4981-aecb-58ed77ef0ae0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:36.360826 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1a7e9e1e-699b-4981-aecb-58ed77ef0ae0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.245888 Sep 05 12:21:36.362382 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 109/207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:36 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:37.390654 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b55d3177-2628-46a2-be7a-6d918c780f22 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:37.391358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b55d3177-2628-46a2-be7a-6d918c780f22 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:37.399161 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b55d3177-2628-46a2-be7a-6d918c780f22 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:37.400004 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b55d3177-2628-46a2-be7a-6d918c780f22 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:37.400343 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b55d3177-2628-46a2-be7a-6d918c780f22 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:37.401044 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b55d3177-2628-46a2-be7a-6d918c780f22 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:37.401499 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b55d3177-2628-46a2-be7a-6d918c780f22 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:37.401924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b55d3177-2628-46a2-be7a-6d918c780f22 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:37.563253 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b55d3177-2628-46a2-be7a-6d918c780f22 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:37.574828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b55d3177-2628-46a2-be7a-6d918c780f22 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.188331 Sep 05 12:21:37.575428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 99/208] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:37 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:38.603782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-80c33cdd-82c6-4f0c-a8ae-8a8b6b45e7e8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:38.605008 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-80c33cdd-82c6-4f0c-a8ae-8a8b6b45e7e8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:38.611847 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-80c33cdd-82c6-4f0c-a8ae-8a8b6b45e7e8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:38.612717 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-80c33cdd-82c6-4f0c-a8ae-8a8b6b45e7e8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:38.613395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-80c33cdd-82c6-4f0c-a8ae-8a8b6b45e7e8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:38.614113 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-80c33cdd-82c6-4f0c-a8ae-8a8b6b45e7e8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:38.614576 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-80c33cdd-82c6-4f0c-a8ae-8a8b6b45e7e8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:38.615009 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-80c33cdd-82c6-4f0c-a8ae-8a8b6b45e7e8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:38.756054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-80c33cdd-82c6-4f0c-a8ae-8a8b6b45e7e8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:38.767048 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-80c33cdd-82c6-4f0c-a8ae-8a8b6b45e7e8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.168180 Sep 05 12:21:38.778396 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 110/209] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:38 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:21:39.793575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-346a7f06-9f4e-492f-bfde-9f38de68c4e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:39.794336 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-346a7f06-9f4e-492f-bfde-9f38de68c4e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:39.802891 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-346a7f06-9f4e-492f-bfde-9f38de68c4e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:39.802891 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-346a7f06-9f4e-492f-bfde-9f38de68c4e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:39.803312 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-346a7f06-9f4e-492f-bfde-9f38de68c4e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:39.804071 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-346a7f06-9f4e-492f-bfde-9f38de68c4e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:39.804613 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-346a7f06-9f4e-492f-bfde-9f38de68c4e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:39.805025 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-346a7f06-9f4e-492f-bfde-9f38de68c4e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:39.970976 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-346a7f06-9f4e-492f-bfde-9f38de68c4e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:39.983741 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-346a7f06-9f4e-492f-bfde-9f38de68c4e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.193804 Sep 05 12:21:39.986288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 100/210] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:39 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:41.009353 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9564c485-9bff-4d32-839b-4113a0e76862 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:41.010167 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9564c485-9bff-4d32-839b-4113a0e76862 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:41.018143 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9564c485-9bff-4d32-839b-4113a0e76862 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:41.018822 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9564c485-9bff-4d32-839b-4113a0e76862 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:41.019423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9564c485-9bff-4d32-839b-4113a0e76862 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:41.020334 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9564c485-9bff-4d32-839b-4113a0e76862 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:41.021121 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9564c485-9bff-4d32-839b-4113a0e76862 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:41.021752 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9564c485-9bff-4d32-839b-4113a0e76862 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:41.212991 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9564c485-9bff-4d32-839b-4113a0e76862 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:41.226734 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9564c485-9bff-4d32-839b-4113a0e76862 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.221097 Sep 05 12:21:41.227310 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 111/211] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:41 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:42.253876 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4d2a9b8c-4ef0-4474-9b2f-6b34aedf6ca1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:42.255189 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4d2a9b8c-4ef0-4474-9b2f-6b34aedf6ca1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:42.262497 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4d2a9b8c-4ef0-4474-9b2f-6b34aedf6ca1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:42.263015 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4d2a9b8c-4ef0-4474-9b2f-6b34aedf6ca1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:42.263494 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4d2a9b8c-4ef0-4474-9b2f-6b34aedf6ca1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:42.264247 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4d2a9b8c-4ef0-4474-9b2f-6b34aedf6ca1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:42.264855 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4d2a9b8c-4ef0-4474-9b2f-6b34aedf6ca1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:42.265284 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4d2a9b8c-4ef0-4474-9b2f-6b34aedf6ca1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:42.462061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4d2a9b8c-4ef0-4474-9b2f-6b34aedf6ca1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:42.471809 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4d2a9b8c-4ef0-4474-9b2f-6b34aedf6ca1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.222465 Sep 05 12:21:42.472407 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 101/212] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:42 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:21:43.508526 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-98e787d1-e123-4a0d-a028-2dd73fba0fad tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:43.509274 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-98e787d1-e123-4a0d-a028-2dd73fba0fad tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:43.519142 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98e787d1-e123-4a0d-a028-2dd73fba0fad tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:43.519779 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98e787d1-e123-4a0d-a028-2dd73fba0fad tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:43.520419 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98e787d1-e123-4a0d-a028-2dd73fba0fad tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:43.521975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98e787d1-e123-4a0d-a028-2dd73fba0fad tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:43.522816 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98e787d1-e123-4a0d-a028-2dd73fba0fad tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:43.523686 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98e787d1-e123-4a0d-a028-2dd73fba0fad tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:43.722552 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-98e787d1-e123-4a0d-a028-2dd73fba0fad tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:43.731547 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-98e787d1-e123-4a0d-a028-2dd73fba0fad tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.230747 Sep 05 12:21:43.732153 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 112/213] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:43 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:44.775759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f5bf2f46-c18b-4b36-bf9e-85edc5c54449 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:44.776383 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f5bf2f46-c18b-4b36-bf9e-85edc5c54449 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:44.783267 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f5bf2f46-c18b-4b36-bf9e-85edc5c54449 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:44.784213 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f5bf2f46-c18b-4b36-bf9e-85edc5c54449 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:44.784647 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f5bf2f46-c18b-4b36-bf9e-85edc5c54449 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:44.785613 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f5bf2f46-c18b-4b36-bf9e-85edc5c54449 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:44.786091 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f5bf2f46-c18b-4b36-bf9e-85edc5c54449 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:44.786511 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f5bf2f46-c18b-4b36-bf9e-85edc5c54449 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:44.972282 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f5bf2f46-c18b-4b36-bf9e-85edc5c54449 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:44.980493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f5bf2f46-c18b-4b36-bf9e-85edc5c54449 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.210364 Sep 05 12:21:44.981335 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 102/214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:44 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:46.016640 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e2755950-1309-49f2-9bb9-0d0bf85b8c97 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:46.018891 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e2755950-1309-49f2-9bb9-0d0bf85b8c97 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:46.031743 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e2755950-1309-49f2-9bb9-0d0bf85b8c97 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:46.032639 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e2755950-1309-49f2-9bb9-0d0bf85b8c97 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:46.034099 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e2755950-1309-49f2-9bb9-0d0bf85b8c97 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:46.035705 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e2755950-1309-49f2-9bb9-0d0bf85b8c97 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:46.036570 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e2755950-1309-49f2-9bb9-0d0bf85b8c97 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:46.037445 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e2755950-1309-49f2-9bb9-0d0bf85b8c97 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:46.241483 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e2755950-1309-49f2-9bb9-0d0bf85b8c97 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:46.261454 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e2755950-1309-49f2-9bb9-0d0bf85b8c97 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.251918 Sep 05 12:21:46.268148 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 113/215] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:46 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:47.297918 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c0fee22e-5192-4cb2-b7e1-2c63ad12358e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:47.298511 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c0fee22e-5192-4cb2-b7e1-2c63ad12358e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:47.305574 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0fee22e-5192-4cb2-b7e1-2c63ad12358e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:47.306056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0fee22e-5192-4cb2-b7e1-2c63ad12358e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:47.306487 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0fee22e-5192-4cb2-b7e1-2c63ad12358e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:47.307185 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0fee22e-5192-4cb2-b7e1-2c63ad12358e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:47.307664 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0fee22e-5192-4cb2-b7e1-2c63ad12358e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:47.308086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0fee22e-5192-4cb2-b7e1-2c63ad12358e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:47.455976 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c0fee22e-5192-4cb2-b7e1-2c63ad12358e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:47.465389 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c0fee22e-5192-4cb2-b7e1-2c63ad12358e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.171347 Sep 05 12:21:47.466347 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 103/216] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:47 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:48.499714 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-cddb29a6-56ca-4334-8325-6d2748b4b6e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:48.500472 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-cddb29a6-56ca-4334-8325-6d2748b4b6e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:48.509370 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cddb29a6-56ca-4334-8325-6d2748b4b6e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:48.510678 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cddb29a6-56ca-4334-8325-6d2748b4b6e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:48.511322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cddb29a6-56ca-4334-8325-6d2748b4b6e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:48.512733 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cddb29a6-56ca-4334-8325-6d2748b4b6e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:48.513658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cddb29a6-56ca-4334-8325-6d2748b4b6e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:48.514341 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cddb29a6-56ca-4334-8325-6d2748b4b6e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:48.682815 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-cddb29a6-56ca-4334-8325-6d2748b4b6e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:48.693300 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-cddb29a6-56ca-4334-8325-6d2748b4b6e6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.199033 Sep 05 12:21:48.694006 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 114/217] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:48 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:21:49.716563 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ef6e4c4e-29e4-47ec-9048-9a4e195fa010 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:49.717182 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ef6e4c4e-29e4-47ec-9048-9a4e195fa010 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:49.724132 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef6e4c4e-29e4-47ec-9048-9a4e195fa010 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:49.724613 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef6e4c4e-29e4-47ec-9048-9a4e195fa010 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:49.725040 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef6e4c4e-29e4-47ec-9048-9a4e195fa010 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:49.725737 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef6e4c4e-29e4-47ec-9048-9a4e195fa010 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:49.726183 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef6e4c4e-29e4-47ec-9048-9a4e195fa010 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:49.726604 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef6e4c4e-29e4-47ec-9048-9a4e195fa010 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:49.874992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ef6e4c4e-29e4-47ec-9048-9a4e195fa010 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:49.883575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ef6e4c4e-29e4-47ec-9048-9a4e195fa010 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.170684 Sep 05 12:21:49.884177 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 104/218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:49 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:21:50.909833 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-369a50af-faad-4cf2-b6d3-17c75cb776fc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:50.910402 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-369a50af-faad-4cf2-b6d3-17c75cb776fc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:50.916615 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-369a50af-faad-4cf2-b6d3-17c75cb776fc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:50.917101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-369a50af-faad-4cf2-b6d3-17c75cb776fc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:50.917535 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-369a50af-faad-4cf2-b6d3-17c75cb776fc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:50.918233 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-369a50af-faad-4cf2-b6d3-17c75cb776fc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:50.918694 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-369a50af-faad-4cf2-b6d3-17c75cb776fc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:50.919124 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-369a50af-faad-4cf2-b6d3-17c75cb776fc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:51.058885 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-369a50af-faad-4cf2-b6d3-17c75cb776fc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:51.068943 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-369a50af-faad-4cf2-b6d3-17c75cb776fc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.164336 Sep 05 12:21:51.069636 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 115/219] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:50 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:51.179128 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1075820892", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "networks": [{"uuid": "5f030554-440f-4d71-a209-929c7d0f2616"}]}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:51.232777 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.network.neutron [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] validate_networks() for [('5f030554-440f-4d71-a209-929c7d0f2616', None, None, None, None, None)] {{(pid=120535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:21:51.606847 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Flavor limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:21:51.606847 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Image limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:21:51.606847 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Flavor pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:21:51.608079 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Image pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:21:51.608717 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:21:51.618494 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:51.618975 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:51.619411 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:51.620183 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:51.620634 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:51.621063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:51.641327 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Getting quotas for project 57a93fc888a145c88b28b8b73060731e. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:21:51.645945 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Getting quotas for user 4e187162f3e64acdb8cd24f660ceeca6 and project 57a93fc888a145c88b28b8b73060731e. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:21:51.657920 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Going to run 1 instances... {{(pid=120535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:21:51.661517 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:21:51.711197 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-71668733-390c-45f7-858c-50ef264f8815 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535787 Sep 05 12:21:51.718023 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 105/220] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:21:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:21:51.723407 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-386061dc-4c2f-4524-9aed-407957bb246a tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:51.724276 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-386061dc-4c2f-4524-9aed-407957bb246a tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:51.791955 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-386061dc-4c2f-4524-9aed-407957bb246a tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:51.804109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-386061dc-4c2f-4524-9aed-407957bb246a tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1219 microversion: 2.1 time: 0.084507 Sep 05 12:21:51.804841 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 116/221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:51 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:52.093306 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-699b89f4-9c1b-474b-bbd3-689058484c82 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:52.094198 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-699b89f4-9c1b-474b-bbd3-689058484c82 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:52.105899 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-699b89f4-9c1b-474b-bbd3-689058484c82 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:52.107013 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-699b89f4-9c1b-474b-bbd3-689058484c82 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:52.108014 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-699b89f4-9c1b-474b-bbd3-689058484c82 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:52.109441 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-699b89f4-9c1b-474b-bbd3-689058484c82 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:52.110207 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-699b89f4-9c1b-474b-bbd3-689058484c82 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:52.110913 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-699b89f4-9c1b-474b-bbd3-689058484c82 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:52.299287 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-699b89f4-9c1b-474b-bbd3-689058484c82 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:52.307985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-699b89f4-9c1b-474b-bbd3-689058484c82 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.220089 Sep 05 12:21:52.308563 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 106/222] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:52 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:52.828116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a57ab086-caa4-4952-b74c-f1d00ca88e42 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:52.828648 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a57ab086-caa4-4952-b74c-f1d00ca88e42 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:52.835592 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a57ab086-caa4-4952-b74c-f1d00ca88e42 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:52.836088 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a57ab086-caa4-4952-b74c-f1d00ca88e42 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:52.836551 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a57ab086-caa4-4952-b74c-f1d00ca88e42 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:52.837262 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a57ab086-caa4-4952-b74c-f1d00ca88e42 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:52.837719 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a57ab086-caa4-4952-b74c-f1d00ca88e42 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:52.838149 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a57ab086-caa4-4952-b74c-f1d00ca88e42 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:52.906909 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a57ab086-caa4-4952-b74c-f1d00ca88e42 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:52.915633 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a57ab086-caa4-4952-b74c-f1d00ca88e42 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1223 microversion: 2.1 time: 0.091358 Sep 05 12:21:52.916236 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 117/223] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:52 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:53.335847 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1e1f0065-9c3d-4804-8309-fd103677589c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:53.336542 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-1e1f0065-9c3d-4804-8309-fd103677589c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:53.343982 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1e1f0065-9c3d-4804-8309-fd103677589c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:53.344763 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1e1f0065-9c3d-4804-8309-fd103677589c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:53.345516 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1e1f0065-9c3d-4804-8309-fd103677589c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:53.346736 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1e1f0065-9c3d-4804-8309-fd103677589c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:53.347544 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1e1f0065-9c3d-4804-8309-fd103677589c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:53.348333 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1e1f0065-9c3d-4804-8309-fd103677589c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:53.498675 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1e1f0065-9c3d-4804-8309-fd103677589c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:53.508016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1e1f0065-9c3d-4804-8309-fd103677589c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.179371 Sep 05 12:21:53.508788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 107/224] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:53 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:53.942174 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-00ca5492-b8b9-4932-b5b6-e2a6cf0e8401 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:53.943034 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-00ca5492-b8b9-4932-b5b6-e2a6cf0e8401 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:53.950081 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00ca5492-b8b9-4932-b5b6-e2a6cf0e8401 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:53.950643 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00ca5492-b8b9-4932-b5b6-e2a6cf0e8401 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:53.951096 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00ca5492-b8b9-4932-b5b6-e2a6cf0e8401 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:53.951895 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00ca5492-b8b9-4932-b5b6-e2a6cf0e8401 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:53.952348 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00ca5492-b8b9-4932-b5b6-e2a6cf0e8401 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:53.952786 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00ca5492-b8b9-4932-b5b6-e2a6cf0e8401 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:54.021007 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-00ca5492-b8b9-4932-b5b6-e2a6cf0e8401 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:54.031224 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-00ca5492-b8b9-4932-b5b6-e2a6cf0e8401 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1223 microversion: 2.1 time: 0.096541 Sep 05 12:21:54.031858 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 118/225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:53 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:54.532123 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e1675c8b-57e8-44b9-9404-f7ea1774232c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:54.532768 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e1675c8b-57e8-44b9-9404-f7ea1774232c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:54.540593 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e1675c8b-57e8-44b9-9404-f7ea1774232c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:54.541083 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e1675c8b-57e8-44b9-9404-f7ea1774232c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:54.541512 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e1675c8b-57e8-44b9-9404-f7ea1774232c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:54.542217 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e1675c8b-57e8-44b9-9404-f7ea1774232c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:54.542664 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e1675c8b-57e8-44b9-9404-f7ea1774232c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:54.543082 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e1675c8b-57e8-44b9-9404-f7ea1774232c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:54.703389 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e1675c8b-57e8-44b9-9404-f7ea1774232c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:54.715974 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e1675c8b-57e8-44b9-9404-f7ea1774232c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.187405 Sep 05 12:21:54.716988 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 108/226] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:54 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:55.057795 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-bb627a06-8fc8-4d3a-b5e0-ee4130cf471e tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:55.058412 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-bb627a06-8fc8-4d3a-b5e0-ee4130cf471e tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:55.065807 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb627a06-8fc8-4d3a-b5e0-ee4130cf471e tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:55.066294 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb627a06-8fc8-4d3a-b5e0-ee4130cf471e tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:55.066726 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb627a06-8fc8-4d3a-b5e0-ee4130cf471e tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:55.067419 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb627a06-8fc8-4d3a-b5e0-ee4130cf471e tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:55.067899 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb627a06-8fc8-4d3a-b5e0-ee4130cf471e tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:55.068321 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb627a06-8fc8-4d3a-b5e0-ee4130cf471e tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:55.142958 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-bb627a06-8fc8-4d3a-b5e0-ee4130cf471e tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:55.152475 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-bb627a06-8fc8-4d3a-b5e0-ee4130cf471e tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1223 microversion: 2.1 time: 0.098478 Sep 05 12:21:55.153221 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 119/227] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:55 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:55.743085 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f43e02ae-e32c-4e21-b2d6-7ec99251d53d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:55.744981 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f43e02ae-e32c-4e21-b2d6-7ec99251d53d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:55.752078 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f43e02ae-e32c-4e21-b2d6-7ec99251d53d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:55.752892 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f43e02ae-e32c-4e21-b2d6-7ec99251d53d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:55.753495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f43e02ae-e32c-4e21-b2d6-7ec99251d53d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:55.754382 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f43e02ae-e32c-4e21-b2d6-7ec99251d53d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:55.755192 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f43e02ae-e32c-4e21-b2d6-7ec99251d53d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:55.755785 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f43e02ae-e32c-4e21-b2d6-7ec99251d53d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:55.914860 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f43e02ae-e32c-4e21-b2d6-7ec99251d53d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:55.923063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f43e02ae-e32c-4e21-b2d6-7ec99251d53d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.185141 Sep 05 12:21:55.923716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 109/228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:55 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:56.176483 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7ff87756-3ee2-4d0d-82d1-cc5888435474 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:56.177174 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7ff87756-3ee2-4d0d-82d1-cc5888435474 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:56.183896 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ff87756-3ee2-4d0d-82d1-cc5888435474 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:56.184369 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ff87756-3ee2-4d0d-82d1-cc5888435474 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:56.184800 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ff87756-3ee2-4d0d-82d1-cc5888435474 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:56.185619 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ff87756-3ee2-4d0d-82d1-cc5888435474 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:56.186109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ff87756-3ee2-4d0d-82d1-cc5888435474 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:56.186539 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ff87756-3ee2-4d0d-82d1-cc5888435474 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:56.279102 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7ff87756-3ee2-4d0d-82d1-cc5888435474 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:56.288143 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7ff87756-3ee2-4d0d-82d1-cc5888435474 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1271 microversion: 2.1 time: 0.115256 Sep 05 12:21:56.289219 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 120/229] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:56 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:56.952871 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e24fa2a7-cf24-48d2-a363-c5b318507365 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:56.953417 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e24fa2a7-cf24-48d2-a363-c5b318507365 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:56.960902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e24fa2a7-cf24-48d2-a363-c5b318507365 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:56.961647 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e24fa2a7-cf24-48d2-a363-c5b318507365 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:56.962280 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e24fa2a7-cf24-48d2-a363-c5b318507365 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:56.962992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e24fa2a7-cf24-48d2-a363-c5b318507365 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:56.963460 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e24fa2a7-cf24-48d2-a363-c5b318507365 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:56.964172 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e24fa2a7-cf24-48d2-a363-c5b318507365 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:57.118845 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e24fa2a7-cf24-48d2-a363-c5b318507365 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:57.127782 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e24fa2a7-cf24-48d2-a363-c5b318507365 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.183397 Sep 05 12:21:57.128476 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 110/230] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:56 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:57.325783 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-407ca1a6-c38f-4844-af99-7efb82f223bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:57.326676 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-407ca1a6-c38f-4844-af99-7efb82f223bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:57.334149 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-407ca1a6-c38f-4844-af99-7efb82f223bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:57.334743 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-407ca1a6-c38f-4844-af99-7efb82f223bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:57.335188 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-407ca1a6-c38f-4844-af99-7efb82f223bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:57.335930 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-407ca1a6-c38f-4844-af99-7efb82f223bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:57.336389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-407ca1a6-c38f-4844-af99-7efb82f223bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:57.336974 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-407ca1a6-c38f-4844-af99-7efb82f223bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:57.436231 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-407ca1a6-c38f-4844-af99-7efb82f223bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:57.446299 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-407ca1a6-c38f-4844-af99-7efb82f223bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1277 microversion: 2.1 time: 0.124977 Sep 05 12:21:57.447226 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 121/231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:57 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1277 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:58.152473 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-858f0400-fe08-45f9-a046-17770b9eb8cc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:58.153020 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-858f0400-fe08-45f9-a046-17770b9eb8cc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:58.159741 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-858f0400-fe08-45f9-a046-17770b9eb8cc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:58.160166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-858f0400-fe08-45f9-a046-17770b9eb8cc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:58.160651 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-858f0400-fe08-45f9-a046-17770b9eb8cc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:58.161424 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-858f0400-fe08-45f9-a046-17770b9eb8cc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:58.162014 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-858f0400-fe08-45f9-a046-17770b9eb8cc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:58.162450 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-858f0400-fe08-45f9-a046-17770b9eb8cc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:58.179499 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:58.307313 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-858f0400-fe08-45f9-a046-17770b9eb8cc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:58.316354 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-858f0400-fe08-45f9-a046-17770b9eb8cc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.167411 Sep 05 12:21:58.317269 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 111/232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:58 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:58.470297 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-913ec0e1-87ae-4471-8fc7-a3b63edbac10 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:58.470923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-913ec0e1-87ae-4471-8fc7-a3b63edbac10 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:58.477820 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-913ec0e1-87ae-4471-8fc7-a3b63edbac10 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:58.478275 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-913ec0e1-87ae-4471-8fc7-a3b63edbac10 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:58.478713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-913ec0e1-87ae-4471-8fc7-a3b63edbac10 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:58.479458 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-913ec0e1-87ae-4471-8fc7-a3b63edbac10 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:58.479948 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-913ec0e1-87ae-4471-8fc7-a3b63edbac10 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:58.480386 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-913ec0e1-87ae-4471-8fc7-a3b63edbac10 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:58.694471 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-913ec0e1-87ae-4471-8fc7-a3b63edbac10 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:58.702120 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-913ec0e1-87ae-4471-8fc7-a3b63edbac10 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1319 microversion: 2.1 time: 0.235690 Sep 05 12:21:58.703066 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 122/233] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:58 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:58.751717 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-462033f9-0e62-43e4-bb53-43e58c45a31d req-37d9d283-1dfe-46af-843f-022036928a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28f7109c-1b2e-4b1b-9a90-226fe01d3cdd", "tag": "c5a7515d-ef12-4857-a4a9-d06646b977da"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:58.761871 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-462033f9-0e62-43e4-bb53-43e58c45a31d req-37d9d283-1dfe-46af-843f-022036928a0e service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:58.762489 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-462033f9-0e62-43e4-bb53-43e58c45a31d req-37d9d283-1dfe-46af-843f-022036928a0e service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:58.762775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-462033f9-0e62-43e4-bb53-43e58c45a31d req-37d9d283-1dfe-46af-843f-022036928a0e service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:58.777991 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-462033f9-0e62-43e4-bb53-43e58c45a31d req-37d9d283-1dfe-46af-843f-022036928a0e service nova] Creating event network-changed:c5a7515d-ef12-4857-a4a9-d06646b977da for instance 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd on hv-cinder-85518 Sep 05 12:21:58.785982 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-462033f9-0e62-43e4-bb53-43e58c45a31d req-37d9d283-1dfe-46af-843f-022036928a0e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038289 Sep 05 12:21:58.787464 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 112/234] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:21:59.342612 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-30c67a46-020f-4b04-b5cb-1eecbdd2b45f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:59.343905 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-30c67a46-020f-4b04-b5cb-1eecbdd2b45f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:59.354882 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-30c67a46-020f-4b04-b5cb-1eecbdd2b45f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:59.355426 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-30c67a46-020f-4b04-b5cb-1eecbdd2b45f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:59.355959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-30c67a46-020f-4b04-b5cb-1eecbdd2b45f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:59.357026 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-30c67a46-020f-4b04-b5cb-1eecbdd2b45f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:59.357540 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-30c67a46-020f-4b04-b5cb-1eecbdd2b45f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:59.358037 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-30c67a46-020f-4b04-b5cb-1eecbdd2b45f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:59.527911 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-30c67a46-020f-4b04-b5cb-1eecbdd2b45f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:59.530985 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=100 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:59.540347 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-30c67a46-020f-4b04-b5cb-1eecbdd2b45f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.203521 Sep 05 12:21:59.540968 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 123/235] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:59 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:59.729551 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-bda57d8d-07e7-4c2f-8cb5-ae04408f79d5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:59.730239 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-bda57d8d-07e7-4c2f-8cb5-ae04408f79d5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:21:59.736504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bda57d8d-07e7-4c2f-8cb5-ae04408f79d5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:59.736986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bda57d8d-07e7-4c2f-8cb5-ae04408f79d5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:59.737414 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bda57d8d-07e7-4c2f-8cb5-ae04408f79d5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:59.738593 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bda57d8d-07e7-4c2f-8cb5-ae04408f79d5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:21:59.739042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bda57d8d-07e7-4c2f-8cb5-ae04408f79d5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:21:59.739467 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bda57d8d-07e7-4c2f-8cb5-ae04408f79d5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:21:59.876474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-bda57d8d-07e7-4c2f-8cb5-ae04408f79d5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:21:59.886877 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-bda57d8d-07e7-4c2f-8cb5-ae04408f79d5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1319 microversion: 2.1 time: 0.161891 Sep 05 12:21:59.890125 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 113/236] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:21:59 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:00.565323 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-04431058-24ed-4e57-908b-7814953f401c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:00.566545 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-04431058-24ed-4e57-908b-7814953f401c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:00.577887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-04431058-24ed-4e57-908b-7814953f401c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:00.579055 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-04431058-24ed-4e57-908b-7814953f401c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:00.580349 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-04431058-24ed-4e57-908b-7814953f401c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:00.582084 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-04431058-24ed-4e57-908b-7814953f401c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:00.582713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-04431058-24ed-4e57-908b-7814953f401c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:00.583414 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-04431058-24ed-4e57-908b-7814953f401c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:00.822011 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-04431058-24ed-4e57-908b-7814953f401c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:00.830451 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-04431058-24ed-4e57-908b-7814953f401c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.269032 Sep 05 12:22:00.830961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 124/237] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:00 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:22:00.912951 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-603ea21f-e4b6-454b-84c4-110f4c3d95cd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:00.913868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-603ea21f-e4b6-454b-84c4-110f4c3d95cd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:00.921218 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-603ea21f-e4b6-454b-84c4-110f4c3d95cd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:00.921648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-603ea21f-e4b6-454b-84c4-110f4c3d95cd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:00.922086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-603ea21f-e4b6-454b-84c4-110f4c3d95cd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:00.922846 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-603ea21f-e4b6-454b-84c4-110f4c3d95cd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:00.930520 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-603ea21f-e4b6-454b-84c4-110f4c3d95cd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:00.930989 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-603ea21f-e4b6-454b-84c4-110f4c3d95cd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:01.137721 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-603ea21f-e4b6-454b-84c4-110f4c3d95cd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:01.151940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-603ea21f-e4b6-454b-84c4-110f4c3d95cd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1319 microversion: 2.1 time: 0.242948 Sep 05 12:22:01.167603 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 114/238] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:00 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:01.854637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-85821165-7b94-427f-b7df-abdddca01120 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:01.855423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-85821165-7b94-427f-b7df-abdddca01120 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:01.859215 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:01.860415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=40 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:01.864801 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-85821165-7b94-427f-b7df-abdddca01120 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:01.865379 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-85821165-7b94-427f-b7df-abdddca01120 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:01.865879 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-85821165-7b94-427f-b7df-abdddca01120 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:01.867589 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-85821165-7b94-427f-b7df-abdddca01120 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:01.868125 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-85821165-7b94-427f-b7df-abdddca01120 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:01.868645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-85821165-7b94-427f-b7df-abdddca01120 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:02.076904 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-85821165-7b94-427f-b7df-abdddca01120 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:02.088160 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-85821165-7b94-427f-b7df-abdddca01120 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.237071 Sep 05 12:22:02.089246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 125/239] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:01 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:02.193436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f81be638-097f-40dc-a164-675a7195f234 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:02.196342 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f81be638-097f-40dc-a164-675a7195f234 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:02.201911 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:02.203121 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=6 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:02.205666 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:02.219325 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f81be638-097f-40dc-a164-675a7195f234 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:02.221359 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f81be638-097f-40dc-a164-675a7195f234 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:02.222202 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f81be638-097f-40dc-a164-675a7195f234 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:02.224454 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f81be638-097f-40dc-a164-675a7195f234 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:02.225637 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f81be638-097f-40dc-a164-675a7195f234 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:02.226770 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f81be638-097f-40dc-a164-675a7195f234 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:02.570948 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f81be638-097f-40dc-a164-675a7195f234 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:02.582487 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f81be638-097f-40dc-a164-675a7195f234 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1319 microversion: 2.1 time: 0.397285 Sep 05 12:22:02.583372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 115/240] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:02 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:03.131101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-190d44e6-927b-4028-a6ce-7ef381436043 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:03.139017 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-190d44e6-927b-4028-a6ce-7ef381436043 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:03.160753 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-190d44e6-927b-4028-a6ce-7ef381436043 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:03.164567 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-190d44e6-927b-4028-a6ce-7ef381436043 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:03.166106 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-190d44e6-927b-4028-a6ce-7ef381436043 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:03.172045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-190d44e6-927b-4028-a6ce-7ef381436043 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:03.173075 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-190d44e6-927b-4028-a6ce-7ef381436043 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:03.174179 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-190d44e6-927b-4028-a6ce-7ef381436043 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:03.404556 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-190d44e6-927b-4028-a6ce-7ef381436043 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:03.417048 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-190d44e6-927b-4028-a6ce-7ef381436043 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.293581 Sep 05 12:22:03.417638 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 126/241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:03 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:03.623029 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ef016069-bf12-494c-9015-ba428125dc16 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:03.624308 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ef016069-bf12-494c-9015-ba428125dc16 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:03.634532 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef016069-bf12-494c-9015-ba428125dc16 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:03.635155 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef016069-bf12-494c-9015-ba428125dc16 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:03.635733 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef016069-bf12-494c-9015-ba428125dc16 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:03.636804 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef016069-bf12-494c-9015-ba428125dc16 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:03.638738 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef016069-bf12-494c-9015-ba428125dc16 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:03.639404 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef016069-bf12-494c-9015-ba428125dc16 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:03.996305 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ef016069-bf12-494c-9015-ba428125dc16 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:04.009491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ef016069-bf12-494c-9015-ba428125dc16 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1319 microversion: 2.1 time: 0.390627 Sep 05 12:22:04.010609 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 116/242] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:03 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:04.447775 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f288b314-1440-49ec-87b7-370c9d2f4ee4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:04.449002 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f288b314-1440-49ec-87b7-370c9d2f4ee4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:04.464023 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f288b314-1440-49ec-87b7-370c9d2f4ee4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:04.467846 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f288b314-1440-49ec-87b7-370c9d2f4ee4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:04.469060 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f288b314-1440-49ec-87b7-370c9d2f4ee4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:04.470377 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f288b314-1440-49ec-87b7-370c9d2f4ee4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:04.471271 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f288b314-1440-49ec-87b7-370c9d2f4ee4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:04.472197 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f288b314-1440-49ec-87b7-370c9d2f4ee4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:04.708888 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f288b314-1440-49ec-87b7-370c9d2f4ee4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:04.720723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f288b314-1440-49ec-87b7-370c9d2f4ee4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.281533 Sep 05 12:22:04.721924 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 127/243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:04 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:05.033983 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-09d58e0a-ead1-4993-8fb7-698c48f526a5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:05.034973 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-09d58e0a-ead1-4993-8fb7-698c48f526a5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:05.043501 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-09d58e0a-ead1-4993-8fb7-698c48f526a5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:05.044490 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-09d58e0a-ead1-4993-8fb7-698c48f526a5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:05.044961 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-09d58e0a-ead1-4993-8fb7-698c48f526a5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:05.051395 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-09d58e0a-ead1-4993-8fb7-698c48f526a5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:05.051954 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-09d58e0a-ead1-4993-8fb7-698c48f526a5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:05.052402 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-09d58e0a-ead1-4993-8fb7-698c48f526a5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:05.510845 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-09d58e0a-ead1-4993-8fb7-698c48f526a5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:05.532600 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-09d58e0a-ead1-4993-8fb7-698c48f526a5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1319 microversion: 2.1 time: 0.502478 Sep 05 12:22:05.538069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 117/244] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:05 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1319 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:05.601955 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-a820c54a-1a29-4bac-b7ef-c5f0191e8eba req-c59d8a99-9fc5-4dc8-bc9c-b7fef69e116a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28f7109c-1b2e-4b1b-9a90-226fe01d3cdd", "name": "network-vif-plugged", "status": "completed", "tag": "c5a7515d-ef12-4857-a4a9-d06646b977da"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:05.629423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a820c54a-1a29-4bac-b7ef-c5f0191e8eba req-c59d8a99-9fc5-4dc8-bc9c-b7fef69e116a service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:05.630107 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a820c54a-1a29-4bac-b7ef-c5f0191e8eba req-c59d8a99-9fc5-4dc8-bc9c-b7fef69e116a service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:05.630703 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a820c54a-1a29-4bac-b7ef-c5f0191e8eba req-c59d8a99-9fc5-4dc8-bc9c-b7fef69e116a service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:05.661628 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-a820c54a-1a29-4bac-b7ef-c5f0191e8eba req-c59d8a99-9fc5-4dc8-bc9c-b7fef69e116a service nova] Creating event network-vif-plugged:c5a7515d-ef12-4857-a4a9-d06646b977da for instance 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd on hv-cinder-85518 Sep 05 12:22:05.671114 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-a820c54a-1a29-4bac-b7ef-c5f0191e8eba req-c59d8a99-9fc5-4dc8-bc9c-b7fef69e116a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072675 Sep 05 12:22:05.672457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 128/245] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:22:05.747662 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2624d7d2-5447-4084-93cf-8a84c78e08e4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:05.748426 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2624d7d2-5447-4084-93cf-8a84c78e08e4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:05.757458 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2624d7d2-5447-4084-93cf-8a84c78e08e4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:05.758329 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2624d7d2-5447-4084-93cf-8a84c78e08e4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:05.758999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2624d7d2-5447-4084-93cf-8a84c78e08e4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:05.759994 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2624d7d2-5447-4084-93cf-8a84c78e08e4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:05.760862 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2624d7d2-5447-4084-93cf-8a84c78e08e4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:05.761500 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2624d7d2-5447-4084-93cf-8a84c78e08e4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:06.043984 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2624d7d2-5447-4084-93cf-8a84c78e08e4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:06.059748 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2624d7d2-5447-4084-93cf-8a84c78e08e4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.315783 Sep 05 12:22:06.077291 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 118/246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:05 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:06.572778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2ac41f6c-41ff-41de-b9bd-802af003de70 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:06.577319 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2ac41f6c-41ff-41de-b9bd-802af003de70 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:06.627744 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2ac41f6c-41ff-41de-b9bd-802af003de70 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:06.633990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2ac41f6c-41ff-41de-b9bd-802af003de70 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:06.635248 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2ac41f6c-41ff-41de-b9bd-802af003de70 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:06.636501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2ac41f6c-41ff-41de-b9bd-802af003de70 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:06.637413 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2ac41f6c-41ff-41de-b9bd-802af003de70 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:06.638050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2ac41f6c-41ff-41de-b9bd-802af003de70 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:07.109522 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a09f3081-09b5-41fb-a3cc-665f9aae11a0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:07.113714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a09f3081-09b5-41fb-a3cc-665f9aae11a0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:07.133123 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a09f3081-09b5-41fb-a3cc-665f9aae11a0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:07.135770 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a09f3081-09b5-41fb-a3cc-665f9aae11a0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:07.138200 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a09f3081-09b5-41fb-a3cc-665f9aae11a0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:07.140845 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a09f3081-09b5-41fb-a3cc-665f9aae11a0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:07.142860 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a09f3081-09b5-41fb-a3cc-665f9aae11a0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:07.146043 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a09f3081-09b5-41fb-a3cc-665f9aae11a0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:07.187439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2ac41f6c-41ff-41de-b9bd-802af003de70 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:07.212801 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2ac41f6c-41ff-41de-b9bd-802af003de70 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1319 microversion: 2.1 time: 0.650450 Sep 05 12:22:07.223920 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 129/247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:06 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1319 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:07.460456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a09f3081-09b5-41fb-a3cc-665f9aae11a0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:07.479228 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a09f3081-09b5-41fb-a3cc-665f9aae11a0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.387704 Sep 05 12:22:07.489807 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 119/248] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:07 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:08.247722 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-872bcb6d-ed35-4516-a941-5e0525b77c6c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:08.248990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-872bcb6d-ed35-4516-a941-5e0525b77c6c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:08.264228 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-872bcb6d-ed35-4516-a941-5e0525b77c6c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:08.264915 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-872bcb6d-ed35-4516-a941-5e0525b77c6c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:08.265558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-872bcb6d-ed35-4516-a941-5e0525b77c6c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:08.266469 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-872bcb6d-ed35-4516-a941-5e0525b77c6c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:08.267102 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-872bcb6d-ed35-4516-a941-5e0525b77c6c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:08.268569 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-872bcb6d-ed35-4516-a941-5e0525b77c6c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:08.512807 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-581d15f8-a73f-4be7-8d5c-b28d8a9986d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:08.514661 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-581d15f8-a73f-4be7-8d5c-b28d8a9986d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:08.524357 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-581d15f8-a73f-4be7-8d5c-b28d8a9986d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:08.525532 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-581d15f8-a73f-4be7-8d5c-b28d8a9986d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:08.526277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-581d15f8-a73f-4be7-8d5c-b28d8a9986d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:08.527261 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-581d15f8-a73f-4be7-8d5c-b28d8a9986d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:08.528156 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-581d15f8-a73f-4be7-8d5c-b28d8a9986d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:08.528859 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-581d15f8-a73f-4be7-8d5c-b28d8a9986d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:08.702969 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-872bcb6d-ed35-4516-a941-5e0525b77c6c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:08.749752 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-872bcb6d-ed35-4516-a941-5e0525b77c6c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1319 microversion: 2.1 time: 0.507102 Sep 05 12:22:08.752828 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 130/249] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:08 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:08.826902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-581d15f8-a73f-4be7-8d5c-b28d8a9986d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:08.847855 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-581d15f8-a73f-4be7-8d5c-b28d8a9986d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.341673 Sep 05 12:22:08.849230 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 120/250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:08 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:09.790817 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-fccf8d0f-70ce-4784-b083-d717506ea2a8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:09.792769 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-fccf8d0f-70ce-4784-b083-d717506ea2a8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:09.803424 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fccf8d0f-70ce-4784-b083-d717506ea2a8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:09.803967 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fccf8d0f-70ce-4784-b083-d717506ea2a8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:09.804434 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fccf8d0f-70ce-4784-b083-d717506ea2a8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:09.805145 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fccf8d0f-70ce-4784-b083-d717506ea2a8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:09.805595 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fccf8d0f-70ce-4784-b083-d717506ea2a8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:09.806036 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fccf8d0f-70ce-4784-b083-d717506ea2a8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:09.881566 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1f7a5018-9d9b-457f-b2ea-132347511d9c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:09.882510 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-1f7a5018-9d9b-457f-b2ea-132347511d9c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:09.893488 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1f7a5018-9d9b-457f-b2ea-132347511d9c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:09.894301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1f7a5018-9d9b-457f-b2ea-132347511d9c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:09.894942 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1f7a5018-9d9b-457f-b2ea-132347511d9c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:09.896165 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1f7a5018-9d9b-457f-b2ea-132347511d9c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:09.896804 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1f7a5018-9d9b-457f-b2ea-132347511d9c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:09.897539 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1f7a5018-9d9b-457f-b2ea-132347511d9c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:10.053381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-fccf8d0f-70ce-4784-b083-d717506ea2a8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:10.063966 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-fccf8d0f-70ce-4784-b083-d717506ea2a8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1509 microversion: 2.1 time: 0.278028 Sep 05 12:22:10.085731 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 131/251] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:09 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:22:10.127171 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1f7a5018-9d9b-457f-b2ea-132347511d9c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:10.148474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1f7a5018-9d9b-457f-b2ea-132347511d9c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.270753 Sep 05 12:22:10.158287 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 121/252] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:09 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:22:11.217375 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-642b6af2-8890-4e6c-ad19-51e848aba170 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:11.219310 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-642b6af2-8890-4e6c-ad19-51e848aba170 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:11.239134 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-642b6af2-8890-4e6c-ad19-51e848aba170 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:11.240466 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-642b6af2-8890-4e6c-ad19-51e848aba170 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:11.242301 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-642b6af2-8890-4e6c-ad19-51e848aba170 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:11.244801 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-642b6af2-8890-4e6c-ad19-51e848aba170 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:11.246227 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-642b6af2-8890-4e6c-ad19-51e848aba170 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:11.247305 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-642b6af2-8890-4e6c-ad19-51e848aba170 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:11.691646 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-642b6af2-8890-4e6c-ad19-51e848aba170 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:11.700686 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-642b6af2-8890-4e6c-ad19-51e848aba170 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.501443 Sep 05 12:22:11.701374 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 132/253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:11 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:12.725161 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4ece1702-8270-41e3-a646-327db88fa667 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:12.726006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4ece1702-8270-41e3-a646-327db88fa667 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:12.756640 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4ece1702-8270-41e3-a646-327db88fa667 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:12.757251 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4ece1702-8270-41e3-a646-327db88fa667 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:12.757870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4ece1702-8270-41e3-a646-327db88fa667 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:12.770309 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4ece1702-8270-41e3-a646-327db88fa667 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:12.771043 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4ece1702-8270-41e3-a646-327db88fa667 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:12.788415 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4ece1702-8270-41e3-a646-327db88fa667 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:13.094879 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4ece1702-8270-41e3-a646-327db88fa667 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:13.110235 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4ece1702-8270-41e3-a646-327db88fa667 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.385884 Sep 05 12:22:13.117904 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 122/254] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:12 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:14.145633 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ddb1c735-94e3-4ad8-9f4b-6c8acfe734d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:14.151035 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ddb1c735-94e3-4ad8-9f4b-6c8acfe734d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:14.170900 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:22:14.172556 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Mon Sep 5 12:22:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 (ip 10.222.0.16) !!! Sep 05 12:22:14.177093 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ddb1c735-94e3-4ad8-9f4b-6c8acfe734d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:14.178821 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ddb1c735-94e3-4ad8-9f4b-6c8acfe734d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:14.180176 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ddb1c735-94e3-4ad8-9f4b-6c8acfe734d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:14.182207 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ddb1c735-94e3-4ad8-9f4b-6c8acfe734d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:14.183558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ddb1c735-94e3-4ad8-9f4b-6c8acfe734d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:14.184804 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ddb1c735-94e3-4ad8-9f4b-6c8acfe734d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:14.593541 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ddb1c735-94e3-4ad8-9f4b-6c8acfe734d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:14.616353 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ddb1c735-94e3-4ad8-9f4b-6c8acfe734d6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1521 microversion: 2.1 time: 0.479019 Sep 05 12:22:14.618833 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 133/255] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:14 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:15.666058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-51c094c1-bf38-4f65-aec0-62080ff18ef5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:15.667792 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-51c094c1-bf38-4f65-aec0-62080ff18ef5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:15.677083 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-51c094c1-bf38-4f65-aec0-62080ff18ef5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:15.677995 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-51c094c1-bf38-4f65-aec0-62080ff18ef5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:15.678721 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-51c094c1-bf38-4f65-aec0-62080ff18ef5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:15.680065 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-51c094c1-bf38-4f65-aec0-62080ff18ef5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:15.680807 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-51c094c1-bf38-4f65-aec0-62080ff18ef5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:15.681692 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-51c094c1-bf38-4f65-aec0-62080ff18ef5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:15.936836 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-51c094c1-bf38-4f65-aec0-62080ff18ef5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:15.950520 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-51c094c1-bf38-4f65-aec0-62080ff18ef5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1501 microversion: 2.1 time: 0.290612 Sep 05 12:22:15.951206 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 123/256] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:15 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1501 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:15.976017 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-79519fc7-37da-4afd-909a-9a73f7c95765 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:15.978470 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-79519fc7-37da-4afd-909a-9a73f7c95765 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:15.985510 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79519fc7-37da-4afd-909a-9a73f7c95765 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:15.986367 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79519fc7-37da-4afd-909a-9a73f7c95765 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:15.987072 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79519fc7-37da-4afd-909a-9a73f7c95765 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:15.988837 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79519fc7-37da-4afd-909a-9a73f7c95765 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:15.989384 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79519fc7-37da-4afd-909a-9a73f7c95765 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:15.990032 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79519fc7-37da-4afd-909a-9a73f7c95765 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:16.267871 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-79519fc7-37da-4afd-909a-9a73f7c95765 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:16.277950 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-79519fc7-37da-4afd-909a-9a73f7c95765 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1514 microversion: 2.1 time: 0.306091 Sep 05 12:22:16.278531 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 134/257] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:15 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1514 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:18.157879 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d61f23be-cf65-4e78-8d62-96f31714a1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Action: 'create', calling method: .version_select at 0x7fba4ba8f040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1449146137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKDAJ4OPuhGqqfQY0CmN6I7knKYc6I97ILmx1OOMW+fKVWnLjRcRmGHfaEq+mZRh4KqsO+pbMV/87u+UB/mhPLpMiJbwhVgrky75sljQTd3zauH5ZzuXJwbmBwW+My4RA=="}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:18.183031 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-d61f23be-cf65-4e78-8d62-96f31714a1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Getting quotas for project 88e8ed647b3845119144655e27322ae1. Resources: {'key_pairs'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:22:18.184122 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-d61f23be-cf65-4e78-8d62-96f31714a1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Getting quotas for user 8ff56403efde4509bc830967a1c25ccc and project 88e8ed647b3845119144655e27322ae1. Resources: {'key_pairs'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:22:18.210608 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d61f23be-cf65-4e78-8d62-96f31714a1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [4ac52161-8fbd-4a98-ba77-92a0b1dec3b9] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 05 12:22:19.221088 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO oslo.messaging._drivers.impl_rabbit [None req-d61f23be-cf65-4e78-8d62-96f31714a1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [4ac52161-8fbd-4a98-ba77-92a0b1dec3b9] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34378. Sep 05 12:22:19.252093 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d61f23be-cf65-4e78-8d62-96f31714a1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.373618 Sep 05 12:22:19.252854 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 124/258] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Sep 5 12:22:17 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:20.063874 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-921242f8-8812-4b34-90a9-eead7148a2d4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:20.066390 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-921242f8-8812-4b34-90a9-eead7148a2d4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:20.073060 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-921242f8-8812-4b34-90a9-eead7148a2d4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:20.073652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-921242f8-8812-4b34-90a9-eead7148a2d4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:20.074101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-921242f8-8812-4b34-90a9-eead7148a2d4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:20.074975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-921242f8-8812-4b34-90a9-eead7148a2d4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:20.075516 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-921242f8-8812-4b34-90a9-eead7148a2d4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:20.076070 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-921242f8-8812-4b34-90a9-eead7148a2d4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:20.104894 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.objects.instance [None req-921242f8-8812-4b34-90a9-eead7148a2d4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lazy-loading 'flavor' on Instance uuid 98d0f215-d209-4143-924d-85e2b10edd9e {{(pid=120534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:22:20.260748 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-921242f8-8812-4b34-90a9-eead7148a2d4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "POST /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e/action" status: 200 len: 32 microversion: 2.1 time: 0.200622 Sep 05 12:22:20.262243 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 135/259] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Sep 5 12:22:20 2022] POST /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 05 12:22:20.285156 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-df6a5f63-e7cd-4a3f-8a58-214eb574b96b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:20.286065 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-df6a5f63-e7cd-4a3f-8a58-214eb574b96b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:20.299756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-df6a5f63-e7cd-4a3f-8a58-214eb574b96b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:20.300419 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-df6a5f63-e7cd-4a3f-8a58-214eb574b96b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:20.301092 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-df6a5f63-e7cd-4a3f-8a58-214eb574b96b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:20.302064 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-df6a5f63-e7cd-4a3f-8a58-214eb574b96b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:20.302610 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-df6a5f63-e7cd-4a3f-8a58-214eb574b96b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:20.303276 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-df6a5f63-e7cd-4a3f-8a58-214eb574b96b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:20.512266 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-df6a5f63-e7cd-4a3f-8a58-214eb574b96b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:20.524218 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-df6a5f63-e7cd-4a3f-8a58-214eb574b96b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.253596 Sep 05 12:22:20.525377 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 125/260] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:20 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:21.563652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2da06e42-f873-4aee-a174-7cb5b2a5f45e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:21.566314 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2da06e42-f873-4aee-a174-7cb5b2a5f45e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:21.582406 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2da06e42-f873-4aee-a174-7cb5b2a5f45e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:21.583958 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2da06e42-f873-4aee-a174-7cb5b2a5f45e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:21.585384 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2da06e42-f873-4aee-a174-7cb5b2a5f45e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:21.587484 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2da06e42-f873-4aee-a174-7cb5b2a5f45e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:21.588791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2da06e42-f873-4aee-a174-7cb5b2a5f45e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:21.590498 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2da06e42-f873-4aee-a174-7cb5b2a5f45e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:21.776012 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2da06e42-f873-4aee-a174-7cb5b2a5f45e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:21.788726 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2da06e42-f873-4aee-a174-7cb5b2a5f45e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.234365 Sep 05 12:22:21.789613 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 136/261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:21 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:22:22.815586 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-97d315ab-9a19-4e89-afbe-7d0017067b2b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:22.815586 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-97d315ab-9a19-4e89-afbe-7d0017067b2b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:22.822550 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97d315ab-9a19-4e89-afbe-7d0017067b2b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:22.823089 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97d315ab-9a19-4e89-afbe-7d0017067b2b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:22.823693 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97d315ab-9a19-4e89-afbe-7d0017067b2b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:22.824522 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97d315ab-9a19-4e89-afbe-7d0017067b2b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:22.825096 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97d315ab-9a19-4e89-afbe-7d0017067b2b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:22.825636 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97d315ab-9a19-4e89-afbe-7d0017067b2b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:23.001303 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-97d315ab-9a19-4e89-afbe-7d0017067b2b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:23.015449 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-97d315ab-9a19-4e89-afbe-7d0017067b2b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.206175 Sep 05 12:22:23.016533 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 126/262] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:22 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:24.052732 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d287aea4-937b-4374-88a9-0b01ebd30550 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:24.054133 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d287aea4-937b-4374-88a9-0b01ebd30550 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:24.066723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d287aea4-937b-4374-88a9-0b01ebd30550 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:24.066723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d287aea4-937b-4374-88a9-0b01ebd30550 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:24.066723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d287aea4-937b-4374-88a9-0b01ebd30550 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:24.066723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d287aea4-937b-4374-88a9-0b01ebd30550 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:24.067416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d287aea4-937b-4374-88a9-0b01ebd30550 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:24.067416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d287aea4-937b-4374-88a9-0b01ebd30550 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:24.253524 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d287aea4-937b-4374-88a9-0b01ebd30550 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:24.262122 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d287aea4-937b-4374-88a9-0b01ebd30550 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.214870 Sep 05 12:22:24.262716 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 137/263] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:24 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:22:25.290557 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-748574ba-b081-4e92-b350-27a67b17e732 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:25.291655 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-748574ba-b081-4e92-b350-27a67b17e732 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:25.302389 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-748574ba-b081-4e92-b350-27a67b17e732 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:25.303166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-748574ba-b081-4e92-b350-27a67b17e732 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:25.303925 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-748574ba-b081-4e92-b350-27a67b17e732 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:25.305107 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-748574ba-b081-4e92-b350-27a67b17e732 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:25.305867 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-748574ba-b081-4e92-b350-27a67b17e732 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:25.306571 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-748574ba-b081-4e92-b350-27a67b17e732 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:25.462259 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-748574ba-b081-4e92-b350-27a67b17e732 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:25.474643 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-748574ba-b081-4e92-b350-27a67b17e732 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.191068 Sep 05 12:22:25.475720 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 127/264] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:25 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:26.520392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-010d6385-a523-4ac7-8c08-983e68f10045 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:26.521564 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-010d6385-a523-4ac7-8c08-983e68f10045 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:26.529167 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-010d6385-a523-4ac7-8c08-983e68f10045 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:26.529844 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-010d6385-a523-4ac7-8c08-983e68f10045 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:26.530144 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-010d6385-a523-4ac7-8c08-983e68f10045 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:26.531013 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-010d6385-a523-4ac7-8c08-983e68f10045 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:26.531403 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-010d6385-a523-4ac7-8c08-983e68f10045 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:26.531800 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-010d6385-a523-4ac7-8c08-983e68f10045 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:26.677253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-010d6385-a523-4ac7-8c08-983e68f10045 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:26.685352 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-010d6385-a523-4ac7-8c08-983e68f10045 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.189647 Sep 05 12:22:26.685938 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 138/265] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:26 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:27.708756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-00186927-5425-45dc-bcff-76c2257cb4f7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:27.709290 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-00186927-5425-45dc-bcff-76c2257cb4f7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:27.716001 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-00186927-5425-45dc-bcff-76c2257cb4f7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:27.716494 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-00186927-5425-45dc-bcff-76c2257cb4f7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:27.716933 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-00186927-5425-45dc-bcff-76c2257cb4f7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:27.717640 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-00186927-5425-45dc-bcff-76c2257cb4f7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:27.718097 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-00186927-5425-45dc-bcff-76c2257cb4f7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:27.718527 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-00186927-5425-45dc-bcff-76c2257cb4f7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:27.849051 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-00186927-5425-45dc-bcff-76c2257cb4f7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:27.857071 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-00186927-5425-45dc-bcff-76c2257cb4f7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.152246 Sep 05 12:22:27.857649 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 128/266] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:27 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:28.881306 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-646c93b4-7e12-4daf-8500-9cab9b408b91 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:28.881924 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-646c93b4-7e12-4daf-8500-9cab9b408b91 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:28.888064 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-646c93b4-7e12-4daf-8500-9cab9b408b91 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:28.888548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-646c93b4-7e12-4daf-8500-9cab9b408b91 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:28.889014 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-646c93b4-7e12-4daf-8500-9cab9b408b91 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:28.889716 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-646c93b4-7e12-4daf-8500-9cab9b408b91 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:28.890174 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-646c93b4-7e12-4daf-8500-9cab9b408b91 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:28.890595 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-646c93b4-7e12-4daf-8500-9cab9b408b91 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:28.893428 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:29.033546 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-646c93b4-7e12-4daf-8500-9cab9b408b91 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:29.041268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-646c93b4-7e12-4daf-8500-9cab9b408b91 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.164593 Sep 05 12:22:29.041824 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 139/267] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:28 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:30.064355 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a35b7152-1fa1-478c-972f-165674fa0c36 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:30.064991 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a35b7152-1fa1-478c-972f-165674fa0c36 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:30.067089 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=4 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:30.074110 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a35b7152-1fa1-478c-972f-165674fa0c36 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:30.074625 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a35b7152-1fa1-478c-972f-165674fa0c36 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:30.075066 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a35b7152-1fa1-478c-972f-165674fa0c36 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:30.075800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a35b7152-1fa1-478c-972f-165674fa0c36 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:30.076255 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a35b7152-1fa1-478c-972f-165674fa0c36 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:30.076681 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a35b7152-1fa1-478c-972f-165674fa0c36 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:30.079562 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=96 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:30.219432 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a35b7152-1fa1-478c-972f-165674fa0c36 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:30.227885 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a35b7152-1fa1-478c-972f-165674fa0c36 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.167324 Sep 05 12:22:30.228456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 129/268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:30 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:31.250811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4c54adc8-1df9-4a50-b23a-63250e7c6c66 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:31.251412 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4c54adc8-1df9-4a50-b23a-63250e7c6c66 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:31.258455 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4c54adc8-1df9-4a50-b23a-63250e7c6c66 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:31.258942 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4c54adc8-1df9-4a50-b23a-63250e7c6c66 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:31.259378 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4c54adc8-1df9-4a50-b23a-63250e7c6c66 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:31.260121 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4c54adc8-1df9-4a50-b23a-63250e7c6c66 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:31.260573 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4c54adc8-1df9-4a50-b23a-63250e7c6c66 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:31.260995 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4c54adc8-1df9-4a50-b23a-63250e7c6c66 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:31.389082 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4c54adc8-1df9-4a50-b23a-63250e7c6c66 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:31.396979 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4c54adc8-1df9-4a50-b23a-63250e7c6c66 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.150026 Sep 05 12:22:31.397544 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 140/269] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:31 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:32.420592 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6978b50c-28d6-42c7-9f58-473e973fdb19 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:32.421243 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6978b50c-28d6-42c7-9f58-473e973fdb19 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:32.423648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:32.429209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6978b50c-28d6-42c7-9f58-473e973fdb19 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:32.429708 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6978b50c-28d6-42c7-9f58-473e973fdb19 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:32.430149 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6978b50c-28d6-42c7-9f58-473e973fdb19 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:32.430855 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6978b50c-28d6-42c7-9f58-473e973fdb19 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:32.431311 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6978b50c-28d6-42c7-9f58-473e973fdb19 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:32.431767 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6978b50c-28d6-42c7-9f58-473e973fdb19 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:32.568556 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6978b50c-28d6-42c7-9f58-473e973fdb19 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:32.576102 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6978b50c-28d6-42c7-9f58-473e973fdb19 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.159443 Sep 05 12:22:32.576660 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 130/270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:32 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:33.599779 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0dcfb716-4cc1-4846-a487-9b04c59fa433 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:33.600600 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0dcfb716-4cc1-4846-a487-9b04c59fa433 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:33.602146 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=32 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:33.607454 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0dcfb716-4cc1-4846-a487-9b04c59fa433 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:33.607943 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0dcfb716-4cc1-4846-a487-9b04c59fa433 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:33.608450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0dcfb716-4cc1-4846-a487-9b04c59fa433 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:33.609153 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0dcfb716-4cc1-4846-a487-9b04c59fa433 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:33.609603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0dcfb716-4cc1-4846-a487-9b04c59fa433 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:33.610027 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0dcfb716-4cc1-4846-a487-9b04c59fa433 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:33.743093 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0dcfb716-4cc1-4846-a487-9b04c59fa433 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:33.751734 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0dcfb716-4cc1-4846-a487-9b04c59fa433 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.156728 Sep 05 12:22:33.752408 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 141/271] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:33 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:34.774819 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-48caed6d-1df3-4092-ba1d-a4561943a1bd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:34.776978 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-48caed6d-1df3-4092-ba1d-a4561943a1bd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:34.782472 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-48caed6d-1df3-4092-ba1d-a4561943a1bd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:34.782866 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-48caed6d-1df3-4092-ba1d-a4561943a1bd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:34.783306 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-48caed6d-1df3-4092-ba1d-a4561943a1bd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:34.784046 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-48caed6d-1df3-4092-ba1d-a4561943a1bd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:34.793632 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-48caed6d-1df3-4092-ba1d-a4561943a1bd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:34.794384 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-48caed6d-1df3-4092-ba1d-a4561943a1bd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:34.939120 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-48caed6d-1df3-4092-ba1d-a4561943a1bd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:34.947125 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-48caed6d-1df3-4092-ba1d-a4561943a1bd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.176106 Sep 05 12:22:34.947735 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 131/272] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:34 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:35.970368 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-57d56bce-5d70-46a6-b5bc-078f2ae381bf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:35.970976 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-57d56bce-5d70-46a6-b5bc-078f2ae381bf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:35.977938 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-57d56bce-5d70-46a6-b5bc-078f2ae381bf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:35.978431 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-57d56bce-5d70-46a6-b5bc-078f2ae381bf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:35.978870 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-57d56bce-5d70-46a6-b5bc-078f2ae381bf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:35.979829 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-57d56bce-5d70-46a6-b5bc-078f2ae381bf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:35.979829 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-57d56bce-5d70-46a6-b5bc-078f2ae381bf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:35.981414 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-57d56bce-5d70-46a6-b5bc-078f2ae381bf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:36.116913 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-57d56bce-5d70-46a6-b5bc-078f2ae381bf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:36.124867 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-57d56bce-5d70-46a6-b5bc-078f2ae381bf tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.158348 Sep 05 12:22:36.125452 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 142/273] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:35 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:37.147148 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-957ef25a-d9a6-47d6-8fb5-48c5077034a1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:37.147787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-957ef25a-d9a6-47d6-8fb5-48c5077034a1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:37.154595 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-957ef25a-d9a6-47d6-8fb5-48c5077034a1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:37.155080 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-957ef25a-d9a6-47d6-8fb5-48c5077034a1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:37.155540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-957ef25a-d9a6-47d6-8fb5-48c5077034a1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:37.156249 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-957ef25a-d9a6-47d6-8fb5-48c5077034a1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:37.156709 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-957ef25a-d9a6-47d6-8fb5-48c5077034a1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:37.157134 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-957ef25a-d9a6-47d6-8fb5-48c5077034a1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:37.294681 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-957ef25a-d9a6-47d6-8fb5-48c5077034a1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:37.303665 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-957ef25a-d9a6-47d6-8fb5-48c5077034a1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.160723 Sep 05 12:22:37.304238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 132/274] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:37 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:22:38.327258 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e6310f34-3aea-4781-abb5-71e27b57e8c9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:38.327896 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e6310f34-3aea-4781-abb5-71e27b57e8c9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:38.334604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e6310f34-3aea-4781-abb5-71e27b57e8c9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:38.335082 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e6310f34-3aea-4781-abb5-71e27b57e8c9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:38.335535 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e6310f34-3aea-4781-abb5-71e27b57e8c9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:38.336231 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e6310f34-3aea-4781-abb5-71e27b57e8c9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:38.336689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e6310f34-3aea-4781-abb5-71e27b57e8c9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:38.337119 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e6310f34-3aea-4781-abb5-71e27b57e8c9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:38.464885 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e6310f34-3aea-4781-abb5-71e27b57e8c9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:38.472625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e6310f34-3aea-4781-abb5-71e27b57e8c9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.149305 Sep 05 12:22:38.473189 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 143/275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:38 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:39.496732 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-edbfe307-0aad-4461-993c-bd05517bc0bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:39.497333 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-edbfe307-0aad-4461-993c-bd05517bc0bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:39.503769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-edbfe307-0aad-4461-993c-bd05517bc0bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:39.504242 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-edbfe307-0aad-4461-993c-bd05517bc0bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:39.504669 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-edbfe307-0aad-4461-993c-bd05517bc0bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:39.505342 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-edbfe307-0aad-4461-993c-bd05517bc0bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:39.505825 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-edbfe307-0aad-4461-993c-bd05517bc0bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:39.506242 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-edbfe307-0aad-4461-993c-bd05517bc0bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:39.645882 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-edbfe307-0aad-4461-993c-bd05517bc0bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:39.648986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-edbfe307-0aad-4461-993c-bd05517bc0bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.156122 Sep 05 12:22:39.649549 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 133/276] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:39 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:40.673750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f2fba828-ae04-4a5e-9c7d-2695a6654c4f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:40.674358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f2fba828-ae04-4a5e-9c7d-2695a6654c4f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:40.680469 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2fba828-ae04-4a5e-9c7d-2695a6654c4f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:40.680949 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2fba828-ae04-4a5e-9c7d-2695a6654c4f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:40.681387 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2fba828-ae04-4a5e-9c7d-2695a6654c4f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:40.682076 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2fba828-ae04-4a5e-9c7d-2695a6654c4f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:40.682539 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2fba828-ae04-4a5e-9c7d-2695a6654c4f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:40.682967 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2fba828-ae04-4a5e-9c7d-2695a6654c4f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:40.816755 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f2fba828-ae04-4a5e-9c7d-2695a6654c4f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:40.825114 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f2fba828-ae04-4a5e-9c7d-2695a6654c4f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.155444 Sep 05 12:22:40.825681 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 144/277] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:40 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:41.847723 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-87861125-7898-4289-adaa-37e6bbf3727b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:41.848332 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-87861125-7898-4289-adaa-37e6bbf3727b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:41.854965 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-87861125-7898-4289-adaa-37e6bbf3727b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:41.855478 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-87861125-7898-4289-adaa-37e6bbf3727b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:41.855941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-87861125-7898-4289-adaa-37e6bbf3727b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:41.856623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-87861125-7898-4289-adaa-37e6bbf3727b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:41.857073 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-87861125-7898-4289-adaa-37e6bbf3727b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:41.857492 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-87861125-7898-4289-adaa-37e6bbf3727b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:41.991601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-87861125-7898-4289-adaa-37e6bbf3727b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:41.999567 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-87861125-7898-4289-adaa-37e6bbf3727b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.155703 Sep 05 12:22:42.000142 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 134/278] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:41 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:43.025454 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3c559d6a-7032-4a73-bfea-221f542162aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:43.026238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-3c559d6a-7032-4a73-bfea-221f542162aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:43.032988 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c559d6a-7032-4a73-bfea-221f542162aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:43.033539 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c559d6a-7032-4a73-bfea-221f542162aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:43.035565 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c559d6a-7032-4a73-bfea-221f542162aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:43.035565 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c559d6a-7032-4a73-bfea-221f542162aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:43.035565 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c559d6a-7032-4a73-bfea-221f542162aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:43.035884 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c559d6a-7032-4a73-bfea-221f542162aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:43.176464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-3c559d6a-7032-4a73-bfea-221f542162aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:43.184393 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-3c559d6a-7032-4a73-bfea-221f542162aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.165258 Sep 05 12:22:43.184969 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 145/279] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:43 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:44.209315 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d0da1c35-47f2-4cf9-babe-26e694bd22e0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:44.210226 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d0da1c35-47f2-4cf9-babe-26e694bd22e0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:44.217208 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d0da1c35-47f2-4cf9-babe-26e694bd22e0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:44.217689 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d0da1c35-47f2-4cf9-babe-26e694bd22e0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:44.218121 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d0da1c35-47f2-4cf9-babe-26e694bd22e0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:44.218824 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d0da1c35-47f2-4cf9-babe-26e694bd22e0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:44.219279 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d0da1c35-47f2-4cf9-babe-26e694bd22e0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:44.219748 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d0da1c35-47f2-4cf9-babe-26e694bd22e0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:44.357981 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d0da1c35-47f2-4cf9-babe-26e694bd22e0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:44.366503 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d0da1c35-47f2-4cf9-babe-26e694bd22e0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.160954 Sep 05 12:22:44.368515 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 135/280] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:44 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:45.394058 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-33ba34b7-7d8f-42de-bce8-4997aec8e330 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:45.394662 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-33ba34b7-7d8f-42de-bce8-4997aec8e330 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:45.400828 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-33ba34b7-7d8f-42de-bce8-4997aec8e330 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:45.401381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-33ba34b7-7d8f-42de-bce8-4997aec8e330 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:45.401811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-33ba34b7-7d8f-42de-bce8-4997aec8e330 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:45.402497 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-33ba34b7-7d8f-42de-bce8-4997aec8e330 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:45.402973 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-33ba34b7-7d8f-42de-bce8-4997aec8e330 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:45.403357 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-33ba34b7-7d8f-42de-bce8-4997aec8e330 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:45.533643 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-33ba34b7-7d8f-42de-bce8-4997aec8e330 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:45.541663 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-33ba34b7-7d8f-42de-bce8-4997aec8e330 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1500 microversion: 2.1 time: 0.151187 Sep 05 12:22:45.542490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 146/281] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:45 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1500 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:45.564816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7da63147-b87f-4fb1-9253-b5e38f84c41f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3530bffb-f99b-409a-b653-f940e7d26182"}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:45.567176 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7da63147-b87f-4fb1-9253-b5e38f84c41f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:45.574464 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7da63147-b87f-4fb1-9253-b5e38f84c41f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:45.574951 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7da63147-b87f-4fb1-9253-b5e38f84c41f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:45.575399 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7da63147-b87f-4fb1-9253-b5e38f84c41f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:45.576123 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7da63147-b87f-4fb1-9253-b5e38f84c41f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:45.576594 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7da63147-b87f-4fb1-9253-b5e38f84c41f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:45.577007 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7da63147-b87f-4fb1-9253-b5e38f84c41f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:45.600696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-7da63147-b87f-4fb1-9253-b5e38f84c41f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] HTTP exception thrown: Cannot 'attach_volume' instance 98d0f215-d209-4143-924d-85e2b10edd9e while it is in vm_state rescued Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7da63147-b87f-4fb1-9253-b5e38f84c41f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Request method failure captured: Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: POST /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e/os-volume_attachments HTTP/1.1 Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 74 Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFemrRjsZ90kVZGEYqus02Ie2QEuWipxU6VktRw18WSg3Fpgy9K9kJquxI27KqHdB07zJsep0zf_MlmvFbu20x7ARqbxgkdDrmFUuOBlSs7bfiiMuDgXotQH7Nd3_qhrMVZfo6sO74REUpDPYIGAv4U70gu44RmLra0MEy0GinSKViEY Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 938f765828c545a8840a6983bc5d9e6d Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:22:45.602912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:22:45.604504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_938f765828c545a8840a6983bc5d9e6d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/938f765828c545a8840a6983bc5d9e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/938f765828c545a8840a6983bc5d9e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/938f765828c545a8840a6983bc5d9e6d"}]}] Sep 05 12:22:45.604504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:22:45.604504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 938f765828c545a8840a6983bc5d9e6d Sep 05 12:22:45.604504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:22:45.604504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-ServerRescueNegativeTestJSON-798904028-project Sep 05 12:22:45.604504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:22:45.604504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:22:45.604504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: ff0999bd21bf4db5981053922200be2a Sep 05 12:22:45.604504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-ServerRescueNegativeTestJSON-798904028-project Sep 05 12:22:45.604504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Sep 05 12:22:45.604504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {"volumeAttachment": {"volumeId": "3530bffb-f99b-409a-b653-f940e7d26182"}} Sep 05 12:22:45.604504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Cannot 'attach_volume' instance 98d0f215-d209-4143-924d-85e2b10edd9e while it is in vm_state rescued Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'server_id': '98d0f215-d209-4143-924d-85e2b10edd9e', 'body': {'volumeAttachment': {'volumeId': '3530bffb-f99b-409a-b653-f940e7d26182'}}} Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 98d0f215-d209-4143-924d-85e2b10edd9e in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:22:45.605502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 98d0f215-d209-4143-924d-85e2b10edd9e while it is in vm_state rescued Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:22:45.606985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:22:45.608395 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:22:45.608395 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:22:45.608395 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 98d0f215-d209-4143-924d-85e2b10edd9e while it is in vm_state rescued Sep 05 12:22:45.608395 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:22:45.608395 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7da63147-b87f-4fb1-9253-b5e38f84c41f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Returning 409 to user: Cannot 'attach_volume' instance 98d0f215-d209-4143-924d-85e2b10edd9e while it is in vm_state rescued {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:22:45.608395 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7da63147-b87f-4fb1-9253-b5e38f84c41f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "POST /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043658 Sep 05 12:22:45.608395 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 136/282] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Sep 5 12:22:45 2022] POST /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 05 12:22:45.613344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ec942eab-25d8-425f-9777-b2e25fd3800c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:45.613867 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ec942eab-25d8-425f-9777-b2e25fd3800c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:45.620339 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ec942eab-25d8-425f-9777-b2e25fd3800c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:45.620748 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ec942eab-25d8-425f-9777-b2e25fd3800c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:45.621237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ec942eab-25d8-425f-9777-b2e25fd3800c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:45.621922 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ec942eab-25d8-425f-9777-b2e25fd3800c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:45.622302 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ec942eab-25d8-425f-9777-b2e25fd3800c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:45.622722 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ec942eab-25d8-425f-9777-b2e25fd3800c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:45.690552 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ec942eab-25d8-425f-9777-b2e25fd3800c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "POST /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e/action" status: 202 len: 0 microversion: 2.1 time: 0.080878 Sep 05 12:22:45.691278 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 147/283] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Sep 5 12:22:45 2022] POST /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:22:45.699753 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ea7999c4-b9f3-480b-8681-36c67855aab2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:45.700409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ea7999c4-b9f3-480b-8681-36c67855aab2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:45.707013 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ea7999c4-b9f3-480b-8681-36c67855aab2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:45.707819 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ea7999c4-b9f3-480b-8681-36c67855aab2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:45.708258 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ea7999c4-b9f3-480b-8681-36c67855aab2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:45.708969 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ea7999c4-b9f3-480b-8681-36c67855aab2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:45.709423 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ea7999c4-b9f3-480b-8681-36c67855aab2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:45.709850 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ea7999c4-b9f3-480b-8681-36c67855aab2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:45.871216 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ea7999c4-b9f3-480b-8681-36c67855aab2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:45.879302 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ea7999c4-b9f3-480b-8681-36c67855aab2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1508 microversion: 2.1 time: 0.183506 Sep 05 12:22:45.880161 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 137/284] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:45 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:46.905209 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ffcdd61b-312b-4d7b-b11c-12ae0b04b5fb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:46.905927 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ffcdd61b-312b-4d7b-b11c-12ae0b04b5fb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:46.915120 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ffcdd61b-312b-4d7b-b11c-12ae0b04b5fb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:46.915652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ffcdd61b-312b-4d7b-b11c-12ae0b04b5fb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:46.916096 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ffcdd61b-312b-4d7b-b11c-12ae0b04b5fb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:46.916850 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ffcdd61b-312b-4d7b-b11c-12ae0b04b5fb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:46.917309 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ffcdd61b-312b-4d7b-b11c-12ae0b04b5fb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:46.917779 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ffcdd61b-312b-4d7b-b11c-12ae0b04b5fb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:47.072796 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ffcdd61b-312b-4d7b-b11c-12ae0b04b5fb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:47.081313 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ffcdd61b-312b-4d7b-b11c-12ae0b04b5fb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1508 microversion: 2.1 time: 0.181199 Sep 05 12:22:47.081885 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 148/285] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:46 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:48.108696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-197ffdeb-8af5-4bae-a977-a75dd37e2f3d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:48.109309 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-197ffdeb-8af5-4bae-a977-a75dd37e2f3d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:48.115476 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-197ffdeb-8af5-4bae-a977-a75dd37e2f3d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:48.115983 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-197ffdeb-8af5-4bae-a977-a75dd37e2f3d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:48.117065 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-197ffdeb-8af5-4bae-a977-a75dd37e2f3d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:48.117774 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-197ffdeb-8af5-4bae-a977-a75dd37e2f3d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:48.118221 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-197ffdeb-8af5-4bae-a977-a75dd37e2f3d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:48.118668 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-197ffdeb-8af5-4bae-a977-a75dd37e2f3d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:48.255515 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-197ffdeb-8af5-4bae-a977-a75dd37e2f3d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:48.263704 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-197ffdeb-8af5-4bae-a977-a75dd37e2f3d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1508 microversion: 2.1 time: 0.163249 Sep 05 12:22:48.264269 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 138/286] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:48 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:49.286241 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-39a20380-af15-4b8e-8ea2-ad26093ed1ca tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:49.286853 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-39a20380-af15-4b8e-8ea2-ad26093ed1ca tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:49.293148 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-39a20380-af15-4b8e-8ea2-ad26093ed1ca tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:49.293634 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-39a20380-af15-4b8e-8ea2-ad26093ed1ca tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:49.294091 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-39a20380-af15-4b8e-8ea2-ad26093ed1ca tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:49.294795 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-39a20380-af15-4b8e-8ea2-ad26093ed1ca tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:49.295275 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-39a20380-af15-4b8e-8ea2-ad26093ed1ca tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:49.295742 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-39a20380-af15-4b8e-8ea2-ad26093ed1ca tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:49.433713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-39a20380-af15-4b8e-8ea2-ad26093ed1ca tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:49.442321 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-39a20380-af15-4b8e-8ea2-ad26093ed1ca tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1508 microversion: 2.1 time: 0.159866 Sep 05 12:22:49.442895 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 149/287] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:49 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:50.465515 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-16672e25-0795-4fd2-aff3-b40b0c14b430 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:50.466155 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-16672e25-0795-4fd2-aff3-b40b0c14b430 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:50.472724 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-16672e25-0795-4fd2-aff3-b40b0c14b430 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:50.473202 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-16672e25-0795-4fd2-aff3-b40b0c14b430 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:50.473659 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-16672e25-0795-4fd2-aff3-b40b0c14b430 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:50.474357 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-16672e25-0795-4fd2-aff3-b40b0c14b430 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:50.474815 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-16672e25-0795-4fd2-aff3-b40b0c14b430 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:50.475239 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-16672e25-0795-4fd2-aff3-b40b0c14b430 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:50.698841 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-16672e25-0795-4fd2-aff3-b40b0c14b430 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:50.707492 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-16672e25-0795-4fd2-aff3-b40b0c14b430 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1508 microversion: 2.1 time: 0.245797 Sep 05 12:22:50.708137 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 139/288] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:50 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:22:51.733884 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b1634144-60ca-4d82-a75e-68e0adcac76f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:51.735622 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b1634144-60ca-4d82-a75e-68e0adcac76f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:51.745248 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b1634144-60ca-4d82-a75e-68e0adcac76f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:51.746356 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b1634144-60ca-4d82-a75e-68e0adcac76f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:51.746906 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b1634144-60ca-4d82-a75e-68e0adcac76f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:51.748060 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b1634144-60ca-4d82-a75e-68e0adcac76f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:51.748723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b1634144-60ca-4d82-a75e-68e0adcac76f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:51.749562 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b1634144-60ca-4d82-a75e-68e0adcac76f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:52.155715 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b1634144-60ca-4d82-a75e-68e0adcac76f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:52.164082 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b1634144-60ca-4d82-a75e-68e0adcac76f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1514 microversion: 2.1 time: 0.436373 Sep 05 12:22:52.164735 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 150/289] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:51 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1514 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:54.090355 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-843018151", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452"}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:54.142399 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.network.neutron [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] validate_networks() for None {{(pid=120535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:22:54.430817 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Flavor limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:22:54.431517 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Image limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:22:54.432162 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Flavor pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:22:54.432743 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Image pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:22:54.433274 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:22:54.445020 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:54.445717 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:54.446554 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:54.447419 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:54.448067 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:54.448582 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:54.467063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Getting quotas for project 5d891c413f984a409b379359a992000a. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:22:54.471828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Getting quotas for user ab0854279bf244198ed61ddff0279655 and project 5d891c413f984a409b379359a992000a. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:22:54.484778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Going to run 1 instances... {{(pid=120535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:22:54.487093 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:22:54.539174 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7fdba3ed-ddaf-4164-a766-2bc4853a9966 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.451562 Sep 05 12:22:54.540590 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 140/290] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:22:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:22:54.559023 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-100d79ed-57f8-42e2-bbd9-0c6f7b5278fd tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:54.560096 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-100d79ed-57f8-42e2-bbd9-0c6f7b5278fd tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:54.636551 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-100d79ed-57f8-42e2-bbd9-0c6f7b5278fd tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:54.645393 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-100d79ed-57f8-42e2-bbd9-0c6f7b5278fd tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1214 microversion: 2.1 time: 0.092704 Sep 05 12:22:54.646281 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 151/291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:54 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:54.649739 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-85404312-1b87-4e1c-8453-a8786c25060f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Action: 'create', calling method: .version_select at 0x7fba4b9d1dc0>, body: {"keypair": {"name": "tempest-keypair-612182563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCRRKv3PnGXHK7QawRbgO/J9wtzxrYBdXuvWSs9LP2K98YjqHQ8eS2KzrEWODLK5Z+fwA8Eka5FeZfze65hNI0pmcApFgDRX5US2NfxhEGoweLBkpA3mvAAzEQzNW9DbQ=="}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:54.668863 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-85404312-1b87-4e1c-8453-a8786c25060f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Getting quotas for project 938f765828c545a8840a6983bc5d9e6d. Resources: {'key_pairs'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:22:54.673095 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-85404312-1b87-4e1c-8453-a8786c25060f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Getting quotas for user ff0999bd21bf4db5981053922200be2a and project 938f765828c545a8840a6983bc5d9e6d. Resources: {'key_pairs'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:22:54.700624 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-85404312-1b87-4e1c-8453-a8786c25060f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056587 Sep 05 12:22:54.701336 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 141/292] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Sep 5 12:22:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:22:54.969844 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0ed2a508-fe11-4864-80b2-0cc64a64a672 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ec62643-0af6-436a-9dde-211c0821414a", "device": "/dev/sdb"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:54.973494 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0ed2a508-fe11-4864-80b2-0cc64a64a672 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:54.982328 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0ed2a508-fe11-4864-80b2-0cc64a64a672 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:54.983277 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0ed2a508-fe11-4864-80b2-0cc64a64a672 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:54.984228 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0ed2a508-fe11-4864-80b2-0cc64a64a672 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:54.985087 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0ed2a508-fe11-4864-80b2-0cc64a64a672 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:54.985758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0ed2a508-fe11-4864-80b2-0cc64a64a672 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:54.986736 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0ed2a508-fe11-4864-80b2-0cc64a64a672 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:55.345112 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0ed2a508-fe11-4864-80b2-0cc64a64a672 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "POST /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380300 Sep 05 12:22:55.352193 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 152/293] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Sep 5 12:22:54 2022] POST /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:55.672374 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-67415d27-15b3-4540-97df-207668a7fa64 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:55.673165 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-67415d27-15b3-4540-97df-207668a7fa64 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:55.680431 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-67415d27-15b3-4540-97df-207668a7fa64 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:55.680919 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-67415d27-15b3-4540-97df-207668a7fa64 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:55.681531 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-67415d27-15b3-4540-97df-207668a7fa64 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:55.682250 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-67415d27-15b3-4540-97df-207668a7fa64 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:55.682882 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-67415d27-15b3-4540-97df-207668a7fa64 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:55.683283 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-67415d27-15b3-4540-97df-207668a7fa64 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:55.762703 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-67415d27-15b3-4540-97df-207668a7fa64 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:55.774329 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-67415d27-15b3-4540-97df-207668a7fa64 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1266 microversion: 2.1 time: 0.106875 Sep 05 12:22:55.774927 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 142/294] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:55 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:56.170819 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1218523475", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ba0f72a-39d7-48a3-9019-b84b5d6d00ba"}], "security_groups": [{"name": "tempest-securitygroup--896724775"}], "key_name": "tempest-keypair-612182563", "user_data": "}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:56.417845 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.network.neutron [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] validate_networks() for [('9ba0f72a-39d7-48a3-9019-b84b5d6d00ba', None, None, None, None, None)] {{(pid=120534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:22:56.802171 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b50c2d87-9a9a-4985-a41a-aea69050e4c8 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:56.802786 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b50c2d87-9a9a-4985-a41a-aea69050e4c8 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:56.810655 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b50c2d87-9a9a-4985-a41a-aea69050e4c8 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:56.811148 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b50c2d87-9a9a-4985-a41a-aea69050e4c8 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:56.811686 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b50c2d87-9a9a-4985-a41a-aea69050e4c8 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:56.812402 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b50c2d87-9a9a-4985-a41a-aea69050e4c8 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:56.812865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b50c2d87-9a9a-4985-a41a-aea69050e4c8 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:56.813932 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b50c2d87-9a9a-4985-a41a-aea69050e4c8 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:56.881135 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b50c2d87-9a9a-4985-a41a-aea69050e4c8 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:56.890711 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b50c2d87-9a9a-4985-a41a-aea69050e4c8 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1272 microversion: 2.1 time: 0.092179 Sep 05 12:22:56.891572 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 143/295] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:56 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:22:57.085065 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Flavor limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:22:57.085487 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Image limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:22:57.085961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Flavor pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:22:57.086366 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Image pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:22:57.086777 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:22:57.096758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:57.097271 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:57.097755 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:57.098504 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:57.098952 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:57.099473 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:57.118942 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Getting quotas for project 938f765828c545a8840a6983bc5d9e6d. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:22:57.123371 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Getting quotas for user ff0999bd21bf4db5981053922200be2a and project 938f765828c545a8840a6983bc5d9e6d. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:22:57.136223 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Going to run 1 instances... {{(pid=120534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:22:57.138643 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:22:57.189923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e2c4229d-82d7-4006-92b2-809799d4f222 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.024143 Sep 05 12:22:57.190640 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 153/296] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:22:56 2022] POST /compute/v2.1/servers => generated 408 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:22:57.205512 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-db55eaa5-0f39-48d2-a0e0-b49ead1ebaa7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:57.207274 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-db55eaa5-0f39-48d2-a0e0-b49ead1ebaa7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:57.269997 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-db55eaa5-0f39-48d2-a0e0-b49ead1ebaa7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:57.278203 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-db55eaa5-0f39-48d2-a0e0-b49ead1ebaa7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1245 microversion: 2.1 time: 0.078905 Sep 05 12:22:57.278820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 144/297] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:57 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:57.915361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-09af402f-9bea-415e-91e2-3687d34f9752 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:57.916009 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-09af402f-9bea-415e-91e2-3687d34f9752 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:57.922546 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-09af402f-9bea-415e-91e2-3687d34f9752 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:57.923039 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-09af402f-9bea-415e-91e2-3687d34f9752 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:57.923486 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-09af402f-9bea-415e-91e2-3687d34f9752 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:57.924228 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-09af402f-9bea-415e-91e2-3687d34f9752 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:57.924683 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-09af402f-9bea-415e-91e2-3687d34f9752 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:57.925117 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-09af402f-9bea-415e-91e2-3687d34f9752 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:58.157643 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-09af402f-9bea-415e-91e2-3687d34f9752 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:58.168612 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-09af402f-9bea-415e-91e2-3687d34f9752 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.257226 Sep 05 12:22:58.179610 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 154/298] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:57 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:58.303564 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9dfc7813-3171-4754-a172-37920d049223 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:58.306106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-9dfc7813-3171-4754-a172-37920d049223 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:58.313249 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9dfc7813-3171-4754-a172-37920d049223 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:58.313883 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9dfc7813-3171-4754-a172-37920d049223 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:58.314625 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9dfc7813-3171-4754-a172-37920d049223 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:58.315348 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9dfc7813-3171-4754-a172-37920d049223 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:58.316560 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9dfc7813-3171-4754-a172-37920d049223 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:58.316560 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9dfc7813-3171-4754-a172-37920d049223 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:58.407831 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-9dfc7813-3171-4754-a172-37920d049223 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:58.421538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9dfc7813-3171-4754-a172-37920d049223 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1297 microversion: 2.1 time: 0.123065 Sep 05 12:22:58.422648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 145/299] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:58 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1297 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:58.515804 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-f6747afd-63ba-4c2f-97ce-2a40dc262a3d req-febf2f86-ba01-45f2-95dd-3c2efba89188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c7311ba-3cf9-456b-a954-a3c8bdda4b6c", "tag": "96326a8d-b87a-4d41-bf8f-f4b3cd06b076"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:58.527275 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-f6747afd-63ba-4c2f-97ce-2a40dc262a3d req-febf2f86-ba01-45f2-95dd-3c2efba89188 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:58.527808 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-f6747afd-63ba-4c2f-97ce-2a40dc262a3d req-febf2f86-ba01-45f2-95dd-3c2efba89188 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:58.528246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-f6747afd-63ba-4c2f-97ce-2a40dc262a3d req-febf2f86-ba01-45f2-95dd-3c2efba89188 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:58.532325 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:58.540960 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-f6747afd-63ba-4c2f-97ce-2a40dc262a3d req-febf2f86-ba01-45f2-95dd-3c2efba89188 service nova] Creating event network-changed:96326a8d-b87a-4d41-bf8f-f4b3cd06b076 for instance 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c on hv-cinder-85518 Sep 05 12:22:58.546218 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-f6747afd-63ba-4c2f-97ce-2a40dc262a3d req-febf2f86-ba01-45f2-95dd-3c2efba89188 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033939 Sep 05 12:22:58.547003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 155/300] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:59.193551 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0b574040-a6a7-4e49-bcc8-ae5ab3af08c3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:59.194216 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0b574040-a6a7-4e49-bcc8-ae5ab3af08c3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:59.201214 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b574040-a6a7-4e49-bcc8-ae5ab3af08c3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:59.202391 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b574040-a6a7-4e49-bcc8-ae5ab3af08c3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:59.202391 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b574040-a6a7-4e49-bcc8-ae5ab3af08c3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:59.203089 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b574040-a6a7-4e49-bcc8-ae5ab3af08c3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:59.203591 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b574040-a6a7-4e49-bcc8-ae5ab3af08c3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:59.204027 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b574040-a6a7-4e49-bcc8-ae5ab3af08c3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:59.421198 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0b574040-a6a7-4e49-bcc8-ae5ab3af08c3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:59.435434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0b574040-a6a7-4e49-bcc8-ae5ab3af08c3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.245778 Sep 05 12:22:59.436434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 146/301] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:59 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:59.451675 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b3a5c89e-dc69-4ad2-aa2f-98db7f456383 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:59.451675 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b3a5c89e-dc69-4ad2-aa2f-98db7f456383 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:22:59.461537 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b3a5c89e-dc69-4ad2-aa2f-98db7f456383 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:59.462249 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b3a5c89e-dc69-4ad2-aa2f-98db7f456383 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:59.462937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b3a5c89e-dc69-4ad2-aa2f-98db7f456383 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:59.464095 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b3a5c89e-dc69-4ad2-aa2f-98db7f456383 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:22:59.464583 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b3a5c89e-dc69-4ad2-aa2f-98db7f456383 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:22:59.465044 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b3a5c89e-dc69-4ad2-aa2f-98db7f456383 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:22:59.569027 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b3a5c89e-dc69-4ad2-aa2f-98db7f456383 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:22:59.578888 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b3a5c89e-dc69-4ad2-aa2f-98db7f456383 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1303 microversion: 2.1 time: 0.136057 Sep 05 12:22:59.579491 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 156/302] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:22:59 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:00.461307 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-eec8d7b3-9f9d-4a2f-afdd-7eeee795d61e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:00.461954 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-eec8d7b3-9f9d-4a2f-afdd-7eeee795d61e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:00.468159 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eec8d7b3-9f9d-4a2f-afdd-7eeee795d61e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:00.468644 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eec8d7b3-9f9d-4a2f-afdd-7eeee795d61e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:00.469083 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eec8d7b3-9f9d-4a2f-afdd-7eeee795d61e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:00.469784 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eec8d7b3-9f9d-4a2f-afdd-7eeee795d61e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:00.470250 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eec8d7b3-9f9d-4a2f-afdd-7eeee795d61e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:00.470680 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eec8d7b3-9f9d-4a2f-afdd-7eeee795d61e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:00.475420 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=90 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:00.601551 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-eec8d7b3-9f9d-4a2f-afdd-7eeee795d61e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:00.602322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ca42e4be-fab1-4758-8b75-88f2e331435d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:00.602942 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ca42e4be-fab1-4758-8b75-88f2e331435d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:00.609023 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca42e4be-fab1-4758-8b75-88f2e331435d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:00.609300 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-eec8d7b3-9f9d-4a2f-afdd-7eeee795d61e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.153429 Sep 05 12:23:00.609506 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca42e4be-fab1-4758-8b75-88f2e331435d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:00.609875 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 147/303] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:00 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:00.610003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca42e4be-fab1-4758-8b75-88f2e331435d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:00.610619 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca42e4be-fab1-4758-8b75-88f2e331435d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:00.611070 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca42e4be-fab1-4758-8b75-88f2e331435d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:00.611493 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca42e4be-fab1-4758-8b75-88f2e331435d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:00.877644 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ca42e4be-fab1-4758-8b75-88f2e331435d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:00.887132 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ca42e4be-fab1-4758-8b75-88f2e331435d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.288173 Sep 05 12:23:00.887493 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 157/304] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:00 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:01.633134 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ed18af06-84d2-4e13-9574-8dd0e1c1161b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:01.633662 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ed18af06-84d2-4e13-9574-8dd0e1c1161b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:01.640251 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed18af06-84d2-4e13-9574-8dd0e1c1161b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:01.640737 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed18af06-84d2-4e13-9574-8dd0e1c1161b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:01.641173 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed18af06-84d2-4e13-9574-8dd0e1c1161b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:01.641870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed18af06-84d2-4e13-9574-8dd0e1c1161b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:01.642327 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed18af06-84d2-4e13-9574-8dd0e1c1161b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:01.642765 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed18af06-84d2-4e13-9574-8dd0e1c1161b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:01.780064 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ed18af06-84d2-4e13-9574-8dd0e1c1161b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:01.788878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ed18af06-84d2-4e13-9574-8dd0e1c1161b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.159394 Sep 05 12:23:01.789513 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 148/305] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:01 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:01.918948 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c532258f-560a-4b41-aff4-eff5c0b0c41c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:01.919377 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c532258f-560a-4b41-aff4-eff5c0b0c41c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:01.925930 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c532258f-560a-4b41-aff4-eff5c0b0c41c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:01.926425 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c532258f-560a-4b41-aff4-eff5c0b0c41c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:01.926867 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c532258f-560a-4b41-aff4-eff5c0b0c41c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:01.927604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c532258f-560a-4b41-aff4-eff5c0b0c41c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:01.928072 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c532258f-560a-4b41-aff4-eff5c0b0c41c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:01.928501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c532258f-560a-4b41-aff4-eff5c0b0c41c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:02.058892 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c532258f-560a-4b41-aff4-eff5c0b0c41c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:02.066656 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c532258f-560a-4b41-aff4-eff5c0b0c41c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.151702 Sep 05 12:23:02.067204 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 158/306] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:01 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:02.813539 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-110f24e9-6ed4-49bd-b27d-7d21afb46aa7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:02.814181 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-110f24e9-6ed4-49bd-b27d-7d21afb46aa7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:02.816657 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:02.824424 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-110f24e9-6ed4-49bd-b27d-7d21afb46aa7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:02.825061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-110f24e9-6ed4-49bd-b27d-7d21afb46aa7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:02.825505 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-110f24e9-6ed4-49bd-b27d-7d21afb46aa7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:02.826231 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-110f24e9-6ed4-49bd-b27d-7d21afb46aa7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:02.826696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-110f24e9-6ed4-49bd-b27d-7d21afb46aa7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:02.827125 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-110f24e9-6ed4-49bd-b27d-7d21afb46aa7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:03.000248 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-110f24e9-6ed4-49bd-b27d-7d21afb46aa7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:03.010839 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-110f24e9-6ed4-49bd-b27d-7d21afb46aa7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.201204 Sep 05 12:23:03.011586 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 149/307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:02 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:03.090756 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b1247d9a-9e96-40d0-9b72-bcaf2bd88630 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:03.091372 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b1247d9a-9e96-40d0-9b72-bcaf2bd88630 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:03.098030 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b1247d9a-9e96-40d0-9b72-bcaf2bd88630 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:03.098519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b1247d9a-9e96-40d0-9b72-bcaf2bd88630 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:03.098951 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b1247d9a-9e96-40d0-9b72-bcaf2bd88630 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:03.099723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b1247d9a-9e96-40d0-9b72-bcaf2bd88630 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:03.100179 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b1247d9a-9e96-40d0-9b72-bcaf2bd88630 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:03.101121 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b1247d9a-9e96-40d0-9b72-bcaf2bd88630 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:03.267401 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b1247d9a-9e96-40d0-9b72-bcaf2bd88630 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:03.276302 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b1247d9a-9e96-40d0-9b72-bcaf2bd88630 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.189998 Sep 05 12:23:03.276876 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 159/308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:03 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:04.034626 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4a6ef124-52ee-4e3c-a8de-6f2d0389f4b3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:04.035329 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4a6ef124-52ee-4e3c-a8de-6f2d0389f4b3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:04.043101 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4a6ef124-52ee-4e3c-a8de-6f2d0389f4b3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:04.043962 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4a6ef124-52ee-4e3c-a8de-6f2d0389f4b3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:04.044666 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4a6ef124-52ee-4e3c-a8de-6f2d0389f4b3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:04.045809 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4a6ef124-52ee-4e3c-a8de-6f2d0389f4b3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:04.046565 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4a6ef124-52ee-4e3c-a8de-6f2d0389f4b3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:04.047479 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4a6ef124-52ee-4e3c-a8de-6f2d0389f4b3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:04.119447 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1176347140", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1449146137", "security_groups": [{"name": "tempest-secgroup-smoke-1611113790"}], "networks": [{"uuid": "7748b345-1a3e-43cd-bc07-73cc84abe1e5"}], "block_device_mapping_v2": [{"uuid": "fbabd9ae-bff3-465c-9f7e-fe0754d04762", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:04.138366 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:04.260642 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4a6ef124-52ee-4e3c-a8de-6f2d0389f4b3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:04.275374 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4a6ef124-52ee-4e3c-a8de-6f2d0389f4b3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.243632 Sep 05 12:23:04.276488 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 150/309] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:04 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:04.293947 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.network.neutron [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] validate_networks() for [('7748b345-1a3e-43cd-bc07-73cc84abe1e5', None, None, None, None, None)] {{(pid=120534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:23:04.305179 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-195fc5da-add7-444a-a2c1-b799c58e2912 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:04.307218 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-195fc5da-add7-444a-a2c1-b799c58e2912 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:04.318759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-195fc5da-add7-444a-a2c1-b799c58e2912 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:04.321420 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-195fc5da-add7-444a-a2c1-b799c58e2912 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:04.322688 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-195fc5da-add7-444a-a2c1-b799c58e2912 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:04.324424 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-195fc5da-add7-444a-a2c1-b799c58e2912 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:04.325825 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-195fc5da-add7-444a-a2c1-b799c58e2912 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:04.327243 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-195fc5da-add7-444a-a2c1-b799c58e2912 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:04.456344 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:04.639897 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-195fc5da-add7-444a-a2c1-b799c58e2912 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:04.649420 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-195fc5da-add7-444a-a2c1-b799c58e2912 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.352115 Sep 05 12:23:04.650103 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 151/310] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:04 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:04.808859 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Flavor limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:23:04.810019 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Image limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:23:04.811133 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Flavor pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:23:04.812197 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Image pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:23:04.813212 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:23:04.833177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:04.833987 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:04.834714 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:04.836409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:04.837524 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:04.838315 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:04.871606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Getting quotas for project 88e8ed647b3845119144655e27322ae1. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:23:04.876714 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Getting quotas for user 8ff56403efde4509bc830967a1c25ccc and project 88e8ed647b3845119144655e27322ae1. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:23:04.944919 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Going to run 1 instances... {{(pid=120534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:23:04.948105 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbabd9ae-bff3-465c-9f7e-fe0754d04762',volume_size=None,volume_type=None)] {{(pid=120534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:23:05.118608 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-eb1ec75c-438b-4f99-8d3a-b657e0c64e20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.006536 Sep 05 12:23:05.120888 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 160/311] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:23:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:23:05.136193 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5e5ef72a-238c-4c58-99bf-3b5797a1c91c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:05.138204 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5e5ef72a-238c-4c58-99bf-3b5797a1c91c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:05.173951 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-94435eb0-7cc0-4c26-a00a-f8ce4f6230ae req-c6b469aa-0205-44a4-83cf-e1842f0b1320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64534ca-02f1-4369-94ac-1b50a063b870", "tag": "6949e5c9-4d88-4c61-a9fc-3ae9edcff7ae"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:05.194624 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-94435eb0-7cc0-4c26-a00a-f8ce4f6230ae req-c6b469aa-0205-44a4-83cf-e1842f0b1320 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:05.195789 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-94435eb0-7cc0-4c26-a00a-f8ce4f6230ae req-c6b469aa-0205-44a4-83cf-e1842f0b1320 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:05.197821 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-94435eb0-7cc0-4c26-a00a-f8ce4f6230ae req-c6b469aa-0205-44a4-83cf-e1842f0b1320 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:05.221117 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-94435eb0-7cc0-4c26-a00a-f8ce4f6230ae req-c6b469aa-0205-44a4-83cf-e1842f0b1320 service nova] Creating event network-changed:6949e5c9-4d88-4c61-a9fc-3ae9edcff7ae for instance f64534ca-02f1-4369-94ac-1b50a063b870 on hv-cinder-85518 Sep 05 12:23:05.233586 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5e5ef72a-238c-4c58-99bf-3b5797a1c91c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:05.237440 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-94435eb0-7cc0-4c26-a00a-f8ce4f6230ae req-c6b469aa-0205-44a4-83cf-e1842f0b1320 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071007 Sep 05 12:23:05.239104 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 161/312] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:23:05.240889 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5e5ef72a-238c-4c58-99bf-3b5797a1c91c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1089 microversion: 2.1 time: 0.111676 Sep 05 12:23:05.264551 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 152/313] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:05 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1089 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:05.314935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-611bb937-236e-44eb-a290-0bc22666715e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:05.315674 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-611bb937-236e-44eb-a290-0bc22666715e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:05.323188 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-611bb937-236e-44eb-a290-0bc22666715e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:05.323363 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-611bb937-236e-44eb-a290-0bc22666715e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:05.323819 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-611bb937-236e-44eb-a290-0bc22666715e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:05.324531 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-611bb937-236e-44eb-a290-0bc22666715e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:05.324993 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-611bb937-236e-44eb-a290-0bc22666715e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:05.325414 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-611bb937-236e-44eb-a290-0bc22666715e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:05.628788 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-611bb937-236e-44eb-a290-0bc22666715e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:05.642368 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-611bb937-236e-44eb-a290-0bc22666715e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.332266 Sep 05 12:23:05.645312 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 162/314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:05 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:05.684960 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-bfcf7fb9-ac2a-4e3e-9728-045ca7da6da3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:05.686392 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-bfcf7fb9-ac2a-4e3e-9728-045ca7da6da3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:05.700812 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bfcf7fb9-ac2a-4e3e-9728-045ca7da6da3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:05.702087 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bfcf7fb9-ac2a-4e3e-9728-045ca7da6da3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:05.703359 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bfcf7fb9-ac2a-4e3e-9728-045ca7da6da3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:05.704977 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bfcf7fb9-ac2a-4e3e-9728-045ca7da6da3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:05.705793 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bfcf7fb9-ac2a-4e3e-9728-045ca7da6da3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:05.706621 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bfcf7fb9-ac2a-4e3e-9728-045ca7da6da3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:06.031056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-bfcf7fb9-ac2a-4e3e-9728-045ca7da6da3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:06.039940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-bfcf7fb9-ac2a-4e3e-9728-045ca7da6da3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.363931 Sep 05 12:23:06.040532 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 153/315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:05 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:06.274414 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3803792b-c7e9-4ba3-92f2-9008aefefa9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:06.276443 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-3803792b-c7e9-4ba3-92f2-9008aefefa9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:06.287677 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3803792b-c7e9-4ba3-92f2-9008aefefa9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:06.288770 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3803792b-c7e9-4ba3-92f2-9008aefefa9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:06.289214 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3803792b-c7e9-4ba3-92f2-9008aefefa9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:06.291682 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3803792b-c7e9-4ba3-92f2-9008aefefa9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:06.292501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3803792b-c7e9-4ba3-92f2-9008aefefa9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:06.293107 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3803792b-c7e9-4ba3-92f2-9008aefefa9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:06.376182 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-3803792b-c7e9-4ba3-92f2-9008aefefa9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:06.393142 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-3803792b-c7e9-4ba3-92f2-9008aefefa9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1187 microversion: 2.1 time: 0.125926 Sep 05 12:23:06.409842 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 163/316] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:06 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1187 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:06.679185 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b2198ce2-399e-4e80-bc71-50966850c186 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:06.681298 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b2198ce2-399e-4e80-bc71-50966850c186 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:06.693580 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b2198ce2-399e-4e80-bc71-50966850c186 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:06.695161 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b2198ce2-399e-4e80-bc71-50966850c186 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:06.696063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b2198ce2-399e-4e80-bc71-50966850c186 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:06.697558 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b2198ce2-399e-4e80-bc71-50966850c186 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:06.698902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b2198ce2-399e-4e80-bc71-50966850c186 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:06.700001 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b2198ce2-399e-4e80-bc71-50966850c186 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:06.852478 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b2198ce2-399e-4e80-bc71-50966850c186 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:06.860601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b2198ce2-399e-4e80-bc71-50966850c186 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.188174 Sep 05 12:23:06.861194 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 154/317] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:06 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:07.063508 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-cc6d59c4-4cb1-4e8c-b012-1eaea8ac4d42 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:07.064062 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-cc6d59c4-4cb1-4e8c-b012-1eaea8ac4d42 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:07.074278 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cc6d59c4-4cb1-4e8c-b012-1eaea8ac4d42 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:07.074784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cc6d59c4-4cb1-4e8c-b012-1eaea8ac4d42 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:07.075237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cc6d59c4-4cb1-4e8c-b012-1eaea8ac4d42 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:07.076035 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cc6d59c4-4cb1-4e8c-b012-1eaea8ac4d42 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:07.076714 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cc6d59c4-4cb1-4e8c-b012-1eaea8ac4d42 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:07.077329 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cc6d59c4-4cb1-4e8c-b012-1eaea8ac4d42 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:07.300734 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-cc6d59c4-4cb1-4e8c-b012-1eaea8ac4d42 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:07.310157 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-cc6d59c4-4cb1-4e8c-b012-1eaea8ac4d42 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.250839 Sep 05 12:23:07.311901 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 164/318] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:07 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:07.441115 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-455e699e-1542-467f-a2dc-a385729a6c07 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:07.442148 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-455e699e-1542-467f-a2dc-a385729a6c07 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:07.450547 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-455e699e-1542-467f-a2dc-a385729a6c07 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:07.451218 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-455e699e-1542-467f-a2dc-a385729a6c07 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:07.451822 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-455e699e-1542-467f-a2dc-a385729a6c07 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:07.452667 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-455e699e-1542-467f-a2dc-a385729a6c07 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:07.453683 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-455e699e-1542-467f-a2dc-a385729a6c07 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:07.454364 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-455e699e-1542-467f-a2dc-a385729a6c07 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:07.552919 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-455e699e-1542-467f-a2dc-a385729a6c07 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:07.562623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-455e699e-1542-467f-a2dc-a385729a6c07 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.127445 Sep 05 12:23:07.563946 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 155/319] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:07 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:07.884406 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d038754f-b5a2-4762-91ec-f998e67354e4 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:07.884927 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d038754f-b5a2-4762-91ec-f998e67354e4 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:07.888744 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-31bdbf0c-a116-4421-9906-09eafd46c6b3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:07.889662 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-31bdbf0c-a116-4421-9906-09eafd46c6b3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:07.891742 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d038754f-b5a2-4762-91ec-f998e67354e4 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:07.892234 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d038754f-b5a2-4762-91ec-f998e67354e4 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:07.892666 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d038754f-b5a2-4762-91ec-f998e67354e4 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:07.893449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d038754f-b5a2-4762-91ec-f998e67354e4 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:07.893909 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d038754f-b5a2-4762-91ec-f998e67354e4 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:07.894337 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d038754f-b5a2-4762-91ec-f998e67354e4 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:07.898558 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-31bdbf0c-a116-4421-9906-09eafd46c6b3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:07.899221 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-31bdbf0c-a116-4421-9906-09eafd46c6b3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:07.899944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-31bdbf0c-a116-4421-9906-09eafd46c6b3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:07.902133 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-31bdbf0c-a116-4421-9906-09eafd46c6b3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:07.902782 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-31bdbf0c-a116-4421-9906-09eafd46c6b3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:07.903481 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-31bdbf0c-a116-4421-9906-09eafd46c6b3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:07.934659 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-31bdbf0c-a116-4421-9906-09eafd46c6b3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/ips" status: 200 len: 146 microversion: 2.1 time: 0.050838 Sep 05 12:23:07.935715 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 156/320] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Sep 5 12:23:07 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/ips => generated 146 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:23:08.051044 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d038754f-b5a2-4762-91ec-f998e67354e4 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:08.059232 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d038754f-b5a2-4762-91ec-f998e67354e4 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.178962 Sep 05 12:23:08.059856 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 165/321] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:07 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:08.340260 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-32e3761f-df01-4b75-9184-8398d6919fe7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:08.341321 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-32e3761f-df01-4b75-9184-8398d6919fe7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:08.352206 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-32e3761f-df01-4b75-9184-8398d6919fe7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:08.353008 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-32e3761f-df01-4b75-9184-8398d6919fe7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:08.353760 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-32e3761f-df01-4b75-9184-8398d6919fe7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:08.354937 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-32e3761f-df01-4b75-9184-8398d6919fe7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:08.355725 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-32e3761f-df01-4b75-9184-8398d6919fe7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:08.356465 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-32e3761f-df01-4b75-9184-8398d6919fe7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:08.581158 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-32e3761f-df01-4b75-9184-8398d6919fe7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:08.590568 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-32e3761f-df01-4b75-9184-8398d6919fe7 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.257537 Sep 05 12:23:08.591302 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 157/322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:08 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:08.592852 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1ad1286d-95d9-4b7c-b0f2-c386a7fb4cf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:08.594505 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1ad1286d-95d9-4b7c-b0f2-c386a7fb4cf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:08.606944 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1ad1286d-95d9-4b7c-b0f2-c386a7fb4cf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:08.607807 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1ad1286d-95d9-4b7c-b0f2-c386a7fb4cf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:08.608517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1ad1286d-95d9-4b7c-b0f2-c386a7fb4cf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:08.609714 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1ad1286d-95d9-4b7c-b0f2-c386a7fb4cf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:08.610503 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1ad1286d-95d9-4b7c-b0f2-c386a7fb4cf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:08.611223 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1ad1286d-95d9-4b7c-b0f2-c386a7fb4cf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:08.710834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1ad1286d-95d9-4b7c-b0f2-c386a7fb4cf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:08.721029 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1ad1286d-95d9-4b7c-b0f2-c386a7fb4cf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.137547 Sep 05 12:23:08.722236 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 166/323] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:08 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:09.084942 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-bbcf8557-c35e-4f29-a84e-21ba7a3eee7d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:09.086278 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-bbcf8557-c35e-4f29-a84e-21ba7a3eee7d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:09.096458 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bbcf8557-c35e-4f29-a84e-21ba7a3eee7d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:09.097048 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bbcf8557-c35e-4f29-a84e-21ba7a3eee7d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:09.097485 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bbcf8557-c35e-4f29-a84e-21ba7a3eee7d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:09.098187 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bbcf8557-c35e-4f29-a84e-21ba7a3eee7d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:09.098645 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bbcf8557-c35e-4f29-a84e-21ba7a3eee7d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:09.099074 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bbcf8557-c35e-4f29-a84e-21ba7a3eee7d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:09.239486 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-bbcf8557-c35e-4f29-a84e-21ba7a3eee7d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:09.248332 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-bbcf8557-c35e-4f29-a84e-21ba7a3eee7d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.167812 Sep 05 12:23:09.249028 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 158/324] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:09 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:09.614662 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-48756ecb-37ea-4163-ba9a-25208cdda64f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:09.615679 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-48756ecb-37ea-4163-ba9a-25208cdda64f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:09.624959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-48756ecb-37ea-4163-ba9a-25208cdda64f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:09.625443 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-48756ecb-37ea-4163-ba9a-25208cdda64f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:09.625882 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-48756ecb-37ea-4163-ba9a-25208cdda64f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:09.626588 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-48756ecb-37ea-4163-ba9a-25208cdda64f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:09.627048 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-48756ecb-37ea-4163-ba9a-25208cdda64f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:09.627514 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-48756ecb-37ea-4163-ba9a-25208cdda64f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:09.749791 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4e2e4766-d14a-4982-8cf4-fea6ab5bddb7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:09.750601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4e2e4766-d14a-4982-8cf4-fea6ab5bddb7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:09.758884 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e2e4766-d14a-4982-8cf4-fea6ab5bddb7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:09.759563 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e2e4766-d14a-4982-8cf4-fea6ab5bddb7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:09.760261 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e2e4766-d14a-4982-8cf4-fea6ab5bddb7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:09.761233 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e2e4766-d14a-4982-8cf4-fea6ab5bddb7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:09.761889 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e2e4766-d14a-4982-8cf4-fea6ab5bddb7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:09.762474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e2e4766-d14a-4982-8cf4-fea6ab5bddb7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:09.778600 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-48756ecb-37ea-4163-ba9a-25208cdda64f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:09.787104 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-48756ecb-37ea-4163-ba9a-25208cdda64f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.176407 Sep 05 12:23:09.787711 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 167/325] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:09 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:09.857325 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4e2e4766-d14a-4982-8cf4-fea6ab5bddb7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:09.865303 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4e2e4766-d14a-4982-8cf4-fea6ab5bddb7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.120803 Sep 05 12:23:09.865817 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 159/326] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:09 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:10.273319 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f2e06bf5-c393-4b06-8abf-f277af5698ee tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:10.273863 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f2e06bf5-c393-4b06-8abf-f277af5698ee tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:10.282483 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2e06bf5-c393-4b06-8abf-f277af5698ee tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:10.282982 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2e06bf5-c393-4b06-8abf-f277af5698ee tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:10.283432 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2e06bf5-c393-4b06-8abf-f277af5698ee tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:10.284171 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2e06bf5-c393-4b06-8abf-f277af5698ee tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:10.284630 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2e06bf5-c393-4b06-8abf-f277af5698ee tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:10.285059 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2e06bf5-c393-4b06-8abf-f277af5698ee tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:10.448797 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f2e06bf5-c393-4b06-8abf-f277af5698ee tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:10.456947 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f2e06bf5-c393-4b06-8abf-f277af5698ee tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.188036 Sep 05 12:23:10.457539 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 168/327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:10 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:10.811053 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0de801f7-64f3-476c-aadf-a595dbcef7a5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:10.811853 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0de801f7-64f3-476c-aadf-a595dbcef7a5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:10.818418 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0de801f7-64f3-476c-aadf-a595dbcef7a5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:10.818908 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0de801f7-64f3-476c-aadf-a595dbcef7a5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:10.819384 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0de801f7-64f3-476c-aadf-a595dbcef7a5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:10.820671 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0de801f7-64f3-476c-aadf-a595dbcef7a5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:10.821132 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0de801f7-64f3-476c-aadf-a595dbcef7a5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:10.821568 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0de801f7-64f3-476c-aadf-a595dbcef7a5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:10.896617 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-cc522bc0-806e-46a2-b3d0-c59192a09bf6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:10.897383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-cc522bc0-806e-46a2-b3d0-c59192a09bf6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:10.904503 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cc522bc0-806e-46a2-b3d0-c59192a09bf6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:10.904989 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cc522bc0-806e-46a2-b3d0-c59192a09bf6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:10.905426 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cc522bc0-806e-46a2-b3d0-c59192a09bf6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:10.906135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cc522bc0-806e-46a2-b3d0-c59192a09bf6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:10.906595 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cc522bc0-806e-46a2-b3d0-c59192a09bf6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:10.907036 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cc522bc0-806e-46a2-b3d0-c59192a09bf6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:10.982618 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-cc522bc0-806e-46a2-b3d0-c59192a09bf6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:10.994952 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-cc522bc0-806e-46a2-b3d0-c59192a09bf6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.102247 Sep 05 12:23:10.996504 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 169/328] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:10 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:11.002751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0de801f7-64f3-476c-aadf-a595dbcef7a5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:11.017749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0de801f7-64f3-476c-aadf-a595dbcef7a5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.210134 Sep 05 12:23:11.019257 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 160/329] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:10 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:11.483875 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-858d340b-eaf3-4bd0-b17d-70e5c37a3696 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:11.484488 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-858d340b-eaf3-4bd0-b17d-70e5c37a3696 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:11.493767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-858d340b-eaf3-4bd0-b17d-70e5c37a3696 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:11.494633 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-858d340b-eaf3-4bd0-b17d-70e5c37a3696 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:11.495425 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-858d340b-eaf3-4bd0-b17d-70e5c37a3696 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:11.496696 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-858d340b-eaf3-4bd0-b17d-70e5c37a3696 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:11.497539 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-858d340b-eaf3-4bd0-b17d-70e5c37a3696 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:11.498297 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-858d340b-eaf3-4bd0-b17d-70e5c37a3696 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:11.679872 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-858d340b-eaf3-4bd0-b17d-70e5c37a3696 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:11.691693 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-858d340b-eaf3-4bd0-b17d-70e5c37a3696 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.211749 Sep 05 12:23:11.692467 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 170/330] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:11 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:12.035885 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5edc2064-7448-444a-8a4b-e9f8f4e8e5cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:12.036692 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5edc2064-7448-444a-8a4b-e9f8f4e8e5cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:12.046865 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-30780a72-9c11-405f-8d55-5ed59caed1ed tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:12.048348 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-30780a72-9c11-405f-8d55-5ed59caed1ed tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:12.065140 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5edc2064-7448-444a-8a4b-e9f8f4e8e5cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:12.065140 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5edc2064-7448-444a-8a4b-e9f8f4e8e5cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:12.065363 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-30780a72-9c11-405f-8d55-5ed59caed1ed tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:12.065363 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-30780a72-9c11-405f-8d55-5ed59caed1ed tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:12.065363 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-30780a72-9c11-405f-8d55-5ed59caed1ed tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:12.065608 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5edc2064-7448-444a-8a4b-e9f8f4e8e5cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:12.065608 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5edc2064-7448-444a-8a4b-e9f8f4e8e5cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:12.065608 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5edc2064-7448-444a-8a4b-e9f8f4e8e5cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:12.065841 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-30780a72-9c11-405f-8d55-5ed59caed1ed tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:12.066749 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-30780a72-9c11-405f-8d55-5ed59caed1ed tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:12.067278 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5edc2064-7448-444a-8a4b-e9f8f4e8e5cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:12.068165 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-30780a72-9c11-405f-8d55-5ed59caed1ed tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:12.146889 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5edc2064-7448-444a-8a4b-e9f8f4e8e5cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:12.156834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5edc2064-7448-444a-8a4b-e9f8f4e8e5cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.126193 Sep 05 12:23:12.157785 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 161/331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:12 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:12.162628 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-a1aad634-cabd-4f74-af06-8029b9e62718 req-4644f37c-90a3-48c3-9b3c-81be424abeed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c7311ba-3cf9-456b-a954-a3c8bdda4b6c", "name": "network-vif-plugged", "status": "completed", "tag": "96326a8d-b87a-4d41-bf8f-f4b3cd06b076"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:12.174695 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-a1aad634-cabd-4f74-af06-8029b9e62718 req-4644f37c-90a3-48c3-9b3c-81be424abeed service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:12.175177 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-a1aad634-cabd-4f74-af06-8029b9e62718 req-4644f37c-90a3-48c3-9b3c-81be424abeed service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:12.175655 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-a1aad634-cabd-4f74-af06-8029b9e62718 req-4644f37c-90a3-48c3-9b3c-81be424abeed service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:12.189273 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-a1aad634-cabd-4f74-af06-8029b9e62718 req-4644f37c-90a3-48c3-9b3c-81be424abeed service nova] Creating event network-vif-plugged:96326a8d-b87a-4d41-bf8f-f4b3cd06b076 for instance 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c on hv-cinder-85518 Sep 05 12:23:12.195654 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-a1aad634-cabd-4f74-af06-8029b9e62718 req-4644f37c-90a3-48c3-9b3c-81be424abeed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035672 Sep 05 12:23:12.196467 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 162/332] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:23:12.251296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-30780a72-9c11-405f-8d55-5ed59caed1ed tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:12.265401 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-30780a72-9c11-405f-8d55-5ed59caed1ed tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.224084 Sep 05 12:23:12.266436 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 171/333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:12 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:12.717761 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-469d3b68-930f-457c-a473-61426ac59f51 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:12.718645 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-469d3b68-930f-457c-a473-61426ac59f51 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:12.725499 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-469d3b68-930f-457c-a473-61426ac59f51 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:12.726543 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-469d3b68-930f-457c-a473-61426ac59f51 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:12.726983 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-469d3b68-930f-457c-a473-61426ac59f51 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:12.727869 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-469d3b68-930f-457c-a473-61426ac59f51 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:12.728511 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-469d3b68-930f-457c-a473-61426ac59f51 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:12.728772 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-469d3b68-930f-457c-a473-61426ac59f51 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:12.892297 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-469d3b68-930f-457c-a473-61426ac59f51 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:12.900678 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-469d3b68-930f-457c-a473-61426ac59f51 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.188451 Sep 05 12:23:12.901258 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 163/334] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:12 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:13.181013 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-250f3631-b1a0-4d82-8bb2-537eaa53f3cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:13.181615 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-250f3631-b1a0-4d82-8bb2-537eaa53f3cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:13.188087 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-250f3631-b1a0-4d82-8bb2-537eaa53f3cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:13.188565 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-250f3631-b1a0-4d82-8bb2-537eaa53f3cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:13.188993 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-250f3631-b1a0-4d82-8bb2-537eaa53f3cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:13.189684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-250f3631-b1a0-4d82-8bb2-537eaa53f3cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:13.190131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-250f3631-b1a0-4d82-8bb2-537eaa53f3cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:13.190547 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-250f3631-b1a0-4d82-8bb2-537eaa53f3cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:13.255001 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-250f3631-b1a0-4d82-8bb2-537eaa53f3cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:13.262965 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-250f3631-b1a0-4d82-8bb2-537eaa53f3cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.085936 Sep 05 12:23:13.263516 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 172/335] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:13 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:13.290272 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ca03a90d-d62e-4c2d-a536-1f62b738204a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:13.290875 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ca03a90d-d62e-4c2d-a536-1f62b738204a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:13.297229 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ca03a90d-d62e-4c2d-a536-1f62b738204a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:13.297727 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ca03a90d-d62e-4c2d-a536-1f62b738204a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:13.298158 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ca03a90d-d62e-4c2d-a536-1f62b738204a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:13.298847 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ca03a90d-d62e-4c2d-a536-1f62b738204a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:13.299327 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ca03a90d-d62e-4c2d-a536-1f62b738204a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:13.299775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ca03a90d-d62e-4c2d-a536-1f62b738204a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:13.438390 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ca03a90d-d62e-4c2d-a536-1f62b738204a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:13.446542 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ca03a90d-d62e-4c2d-a536-1f62b738204a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.160963 Sep 05 12:23:13.447103 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 164/336] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:13 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:13.923374 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7eee4f0e-1d25-4bfb-ab07-7dbdc7492a89 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:13.924014 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7eee4f0e-1d25-4bfb-ab07-7dbdc7492a89 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:13.930964 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7eee4f0e-1d25-4bfb-ab07-7dbdc7492a89 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:13.931458 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7eee4f0e-1d25-4bfb-ab07-7dbdc7492a89 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:13.931993 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7eee4f0e-1d25-4bfb-ab07-7dbdc7492a89 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:13.932713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7eee4f0e-1d25-4bfb-ab07-7dbdc7492a89 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:13.933167 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7eee4f0e-1d25-4bfb-ab07-7dbdc7492a89 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:13.933593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7eee4f0e-1d25-4bfb-ab07-7dbdc7492a89 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:14.078047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7eee4f0e-1d25-4bfb-ab07-7dbdc7492a89 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:14.080395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=100 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:14.087858 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7eee4f0e-1d25-4bfb-ab07-7dbdc7492a89 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.168484 Sep 05 12:23:14.088441 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 173/337] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:13 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:14.287792 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4f41c2a3-9d54-4a68-b37b-f44a692db391 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:14.288936 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4f41c2a3-9d54-4a68-b37b-f44a692db391 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:14.295765 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f41c2a3-9d54-4a68-b37b-f44a692db391 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:14.296430 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f41c2a3-9d54-4a68-b37b-f44a692db391 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:14.296671 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f41c2a3-9d54-4a68-b37b-f44a692db391 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:14.297373 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f41c2a3-9d54-4a68-b37b-f44a692db391 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:14.297824 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f41c2a3-9d54-4a68-b37b-f44a692db391 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:14.298245 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f41c2a3-9d54-4a68-b37b-f44a692db391 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:14.362893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4f41c2a3-9d54-4a68-b37b-f44a692db391 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:14.367007 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=100 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:14.375271 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4f41c2a3-9d54-4a68-b37b-f44a692db391 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.092404 Sep 05 12:23:14.376127 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 165/338] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:14 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:14.469589 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-76f1f5f2-26a6-4f98-8dcc-4a0b31760a53 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:14.470423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-76f1f5f2-26a6-4f98-8dcc-4a0b31760a53 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:14.479108 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-76f1f5f2-26a6-4f98-8dcc-4a0b31760a53 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:14.479634 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-76f1f5f2-26a6-4f98-8dcc-4a0b31760a53 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:14.480081 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-76f1f5f2-26a6-4f98-8dcc-4a0b31760a53 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:14.480790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-76f1f5f2-26a6-4f98-8dcc-4a0b31760a53 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:14.481250 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-76f1f5f2-26a6-4f98-8dcc-4a0b31760a53 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:14.481754 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-76f1f5f2-26a6-4f98-8dcc-4a0b31760a53 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:14.612020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-76f1f5f2-26a6-4f98-8dcc-4a0b31760a53 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:14.619852 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-76f1f5f2-26a6-4f98-8dcc-4a0b31760a53 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.154174 Sep 05 12:23:14.620424 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 174/339] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:14 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:15.112082 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c0736ce5-3b1f-4d0f-b733-71d2d592b521 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:15.112706 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c0736ce5-3b1f-4d0f-b733-71d2d592b521 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:15.119553 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0736ce5-3b1f-4d0f-b733-71d2d592b521 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:15.120293 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0736ce5-3b1f-4d0f-b733-71d2d592b521 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:15.120885 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0736ce5-3b1f-4d0f-b733-71d2d592b521 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:15.121627 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0736ce5-3b1f-4d0f-b733-71d2d592b521 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:15.122427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0736ce5-3b1f-4d0f-b733-71d2d592b521 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:15.122881 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0736ce5-3b1f-4d0f-b733-71d2d592b521 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:15.240840 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=14 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:15.261273 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c0736ce5-3b1f-4d0f-b733-71d2d592b521 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:15.269118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c0736ce5-3b1f-4d0f-b733-71d2d592b521 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.161024 Sep 05 12:23:15.269697 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 166/340] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:15 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:15.402459 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f9388dc3-f299-4212-97f3-18358f2713cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:15.403035 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f9388dc3-f299-4212-97f3-18358f2713cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:15.405101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=4 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:15.405787 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=14 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:15.411972 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9388dc3-f299-4212-97f3-18358f2713cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:15.412471 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9388dc3-f299-4212-97f3-18358f2713cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:15.412915 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9388dc3-f299-4212-97f3-18358f2713cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:15.413692 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9388dc3-f299-4212-97f3-18358f2713cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:15.414135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9388dc3-f299-4212-97f3-18358f2713cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:15.414567 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9388dc3-f299-4212-97f3-18358f2713cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:15.482865 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f9388dc3-f299-4212-97f3-18358f2713cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:15.491735 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f9388dc3-f299-4212-97f3-18358f2713cb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.092858 Sep 05 12:23:15.492313 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 175/341] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:15 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:15.642571 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ae0aa99a-7de6-4db8-b839-a2ca1afa682a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:15.643300 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ae0aa99a-7de6-4db8-b839-a2ca1afa682a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:15.650176 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ae0aa99a-7de6-4db8-b839-a2ca1afa682a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:15.650930 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ae0aa99a-7de6-4db8-b839-a2ca1afa682a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:15.651369 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ae0aa99a-7de6-4db8-b839-a2ca1afa682a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:15.652127 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ae0aa99a-7de6-4db8-b839-a2ca1afa682a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:15.652661 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ae0aa99a-7de6-4db8-b839-a2ca1afa682a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:15.653012 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ae0aa99a-7de6-4db8-b839-a2ca1afa682a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:15.801036 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ae0aa99a-7de6-4db8-b839-a2ca1afa682a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:15.810922 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ae0aa99a-7de6-4db8-b839-a2ca1afa682a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.172136 Sep 05 12:23:15.811898 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 167/342] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:15 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:16.293039 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d4dcf9a4-f016-4512-bd85-b4e629b96fdc tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:16.293767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d4dcf9a4-f016-4512-bd85-b4e629b96fdc tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:16.300376 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d4dcf9a4-f016-4512-bd85-b4e629b96fdc tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:16.302123 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d4dcf9a4-f016-4512-bd85-b4e629b96fdc tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:16.302468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d4dcf9a4-f016-4512-bd85-b4e629b96fdc tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:16.303293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d4dcf9a4-f016-4512-bd85-b4e629b96fdc tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:16.303875 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d4dcf9a4-f016-4512-bd85-b4e629b96fdc tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:16.304378 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d4dcf9a4-f016-4512-bd85-b4e629b96fdc tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:16.452560 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d4dcf9a4-f016-4512-bd85-b4e629b96fdc tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:16.461058 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d4dcf9a4-f016-4512-bd85-b4e629b96fdc tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.172730 Sep 05 12:23:16.461627 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 176/343] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:16 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:16.515978 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-97b4e8ee-8fde-4b7e-9e04-7cdef94dcdb2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:16.516622 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-97b4e8ee-8fde-4b7e-9e04-7cdef94dcdb2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:16.523412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97b4e8ee-8fde-4b7e-9e04-7cdef94dcdb2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:16.523914 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97b4e8ee-8fde-4b7e-9e04-7cdef94dcdb2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:16.524419 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97b4e8ee-8fde-4b7e-9e04-7cdef94dcdb2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:16.525133 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97b4e8ee-8fde-4b7e-9e04-7cdef94dcdb2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:16.525852 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97b4e8ee-8fde-4b7e-9e04-7cdef94dcdb2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:16.526273 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97b4e8ee-8fde-4b7e-9e04-7cdef94dcdb2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:16.589788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-97b4e8ee-8fde-4b7e-9e04-7cdef94dcdb2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:16.598308 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-97b4e8ee-8fde-4b7e-9e04-7cdef94dcdb2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.086319 Sep 05 12:23:16.598906 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 168/344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:16 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:16.838106 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-049e61cb-0d78-4603-8ab8-d19967d1a5d3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:16.839234 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-049e61cb-0d78-4603-8ab8-d19967d1a5d3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:16.851052 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-049e61cb-0d78-4603-8ab8-d19967d1a5d3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:16.851959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-049e61cb-0d78-4603-8ab8-d19967d1a5d3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:16.852768 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-049e61cb-0d78-4603-8ab8-d19967d1a5d3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:16.854076 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-049e61cb-0d78-4603-8ab8-d19967d1a5d3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:16.854917 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-049e61cb-0d78-4603-8ab8-d19967d1a5d3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:16.855741 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-049e61cb-0d78-4603-8ab8-d19967d1a5d3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:17.034969 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-049e61cb-0d78-4603-8ab8-d19967d1a5d3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:17.044320 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-049e61cb-0d78-4603-8ab8-d19967d1a5d3 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.213668 Sep 05 12:23:17.044904 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 177/345] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:16 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:17.485921 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4bc6517a-f01f-439e-8f76-787701dad4f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:17.488700 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4bc6517a-f01f-439e-8f76-787701dad4f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:17.497852 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4bc6517a-f01f-439e-8f76-787701dad4f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:17.498346 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4bc6517a-f01f-439e-8f76-787701dad4f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:17.498797 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4bc6517a-f01f-439e-8f76-787701dad4f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:17.499513 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4bc6517a-f01f-439e-8f76-787701dad4f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:17.500003 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4bc6517a-f01f-439e-8f76-787701dad4f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:17.500436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4bc6517a-f01f-439e-8f76-787701dad4f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:17.621298 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2f8472bc-d126-4c89-8b8d-36c8b13d9449 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:17.622151 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2f8472bc-d126-4c89-8b8d-36c8b13d9449 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:17.630133 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2f8472bc-d126-4c89-8b8d-36c8b13d9449 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:17.630832 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2f8472bc-d126-4c89-8b8d-36c8b13d9449 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:17.631490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2f8472bc-d126-4c89-8b8d-36c8b13d9449 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:17.632656 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2f8472bc-d126-4c89-8b8d-36c8b13d9449 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:17.633474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2f8472bc-d126-4c89-8b8d-36c8b13d9449 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:17.634231 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2f8472bc-d126-4c89-8b8d-36c8b13d9449 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:17.657057 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4bc6517a-f01f-439e-8f76-787701dad4f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:17.666909 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4bc6517a-f01f-439e-8f76-787701dad4f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.187178 Sep 05 12:23:17.667546 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 169/346] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:17 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:17.709222 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2f8472bc-d126-4c89-8b8d-36c8b13d9449 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:17.717810 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2f8472bc-d126-4c89-8b8d-36c8b13d9449 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.100374 Sep 05 12:23:17.718549 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 178/347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:17 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:18.066695 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-372c7cc6-fef0-40cc-9273-896b56d1e9b2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:18.067354 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-372c7cc6-fef0-40cc-9273-896b56d1e9b2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:18.074378 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-372c7cc6-fef0-40cc-9273-896b56d1e9b2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:18.074915 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-372c7cc6-fef0-40cc-9273-896b56d1e9b2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:18.075407 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-372c7cc6-fef0-40cc-9273-896b56d1e9b2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:18.076224 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-372c7cc6-fef0-40cc-9273-896b56d1e9b2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:18.076688 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-372c7cc6-fef0-40cc-9273-896b56d1e9b2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:18.077167 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-372c7cc6-fef0-40cc-9273-896b56d1e9b2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:18.223691 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-372c7cc6-fef0-40cc-9273-896b56d1e9b2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:18.232828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-372c7cc6-fef0-40cc-9273-896b56d1e9b2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.170193 Sep 05 12:23:18.233406 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 170/348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:18 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:18.261679 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2e2b8d43-854b-463b-a259-2984e5425748 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:18.262226 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2e2b8d43-854b-463b-a259-2984e5425748 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:18.269948 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2e2b8d43-854b-463b-a259-2984e5425748 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:18.270473 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2e2b8d43-854b-463b-a259-2984e5425748 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:18.270910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2e2b8d43-854b-463b-a259-2984e5425748 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:18.271709 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2e2b8d43-854b-463b-a259-2984e5425748 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:18.272166 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2e2b8d43-854b-463b-a259-2984e5425748 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:18.272782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2e2b8d43-854b-463b-a259-2984e5425748 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:18.311134 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2e2b8d43-854b-463b-a259-2984e5425748 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/ips" status: 200 len: 152 microversion: 2.20 time: 0.057184 Sep 05 12:23:18.312176 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 179/349] 10.222.0.16 () {60 vars in 1289 bytes} [Mon Sep 5 12:23:18 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/ips => generated 152 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:23:18.690100 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1a87e075-006b-4117-ba67-9582b67031f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:18.690733 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-1a87e075-006b-4117-ba67-9582b67031f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:18.698384 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1a87e075-006b-4117-ba67-9582b67031f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:18.698877 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1a87e075-006b-4117-ba67-9582b67031f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:18.699508 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1a87e075-006b-4117-ba67-9582b67031f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:18.700256 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1a87e075-006b-4117-ba67-9582b67031f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:18.700721 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1a87e075-006b-4117-ba67-9582b67031f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:18.705384 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1a87e075-006b-4117-ba67-9582b67031f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:18.743270 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7ca4d826-bac0-4826-b956-886296b4f87f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:18.744013 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7ca4d826-bac0-4826-b956-886296b4f87f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:18.750377 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ca4d826-bac0-4826-b956-886296b4f87f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:18.750866 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ca4d826-bac0-4826-b956-886296b4f87f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:18.751343 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ca4d826-bac0-4826-b956-886296b4f87f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:18.752840 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ca4d826-bac0-4826-b956-886296b4f87f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:18.753289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ca4d826-bac0-4826-b956-886296b4f87f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:18.753728 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ca4d826-bac0-4826-b956-886296b4f87f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:18.826506 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7ca4d826-bac0-4826-b956-886296b4f87f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:18.837948 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7ca4d826-bac0-4826-b956-886296b4f87f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.099716 Sep 05 12:23:18.838842 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 180/350] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:18 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:18.865442 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1a87e075-006b-4117-ba67-9582b67031f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:18.874453 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1a87e075-006b-4117-ba67-9582b67031f9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.188261 Sep 05 12:23:18.875036 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 171/351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:18 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:19.061843 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-93a95949-1a82-4c2c-a3e4-ebdacb680a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6ce9c2f-409c-42ff-8ff0-15af062d8859"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:19.064454 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-93a95949-1a82-4c2c-a3e4-ebdacb680a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:19.070910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-93a95949-1a82-4c2c-a3e4-ebdacb680a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:19.071400 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-93a95949-1a82-4c2c-a3e4-ebdacb680a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:19.071864 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-93a95949-1a82-4c2c-a3e4-ebdacb680a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:19.072583 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-93a95949-1a82-4c2c-a3e4-ebdacb680a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:19.073047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-93a95949-1a82-4c2c-a3e4-ebdacb680a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:19.073474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-93a95949-1a82-4c2c-a3e4-ebdacb680a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:19.277192 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-465bd774-e629-4587-87ee-e3ea7e93862d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:19.277788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-465bd774-e629-4587-87ee-e3ea7e93862d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:19.285759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-465bd774-e629-4587-87ee-e3ea7e93862d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:19.286316 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-465bd774-e629-4587-87ee-e3ea7e93862d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:19.286806 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-465bd774-e629-4587-87ee-e3ea7e93862d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:19.287612 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-465bd774-e629-4587-87ee-e3ea7e93862d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:19.288737 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-465bd774-e629-4587-87ee-e3ea7e93862d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:19.289232 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-465bd774-e629-4587-87ee-e3ea7e93862d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:19.436975 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-465bd774-e629-4587-87ee-e3ea7e93862d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:19.448442 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-465bd774-e629-4587-87ee-e3ea7e93862d tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.176675 Sep 05 12:23:19.449032 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 172/352] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:19 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:19.863723 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-fc777485-8c95-45ff-ba8a-83fe1d17cf0b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:19.864437 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-fc777485-8c95-45ff-ba8a-83fe1d17cf0b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:19.871332 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fc777485-8c95-45ff-ba8a-83fe1d17cf0b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:19.871849 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fc777485-8c95-45ff-ba8a-83fe1d17cf0b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:19.872285 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fc777485-8c95-45ff-ba8a-83fe1d17cf0b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:19.872983 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fc777485-8c95-45ff-ba8a-83fe1d17cf0b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:19.873484 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fc777485-8c95-45ff-ba8a-83fe1d17cf0b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:19.873867 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fc777485-8c95-45ff-ba8a-83fe1d17cf0b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:19.937263 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-fc777485-8c95-45ff-ba8a-83fe1d17cf0b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:19.946020 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-fc777485-8c95-45ff-ba8a-83fe1d17cf0b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.086236 Sep 05 12:23:19.946591 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 173/353] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:19 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:19.955668 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-40247e9a-9f69-4f4b-a20c-a1ec6ad16675 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:19.955668 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-40247e9a-9f69-4f4b-a20c-a1ec6ad16675 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:19.958840 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-40247e9a-9f69-4f4b-a20c-a1ec6ad16675 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:19.959326 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-40247e9a-9f69-4f4b-a20c-a1ec6ad16675 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:19.959776 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-40247e9a-9f69-4f4b-a20c-a1ec6ad16675 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:19.960499 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-40247e9a-9f69-4f4b-a20c-a1ec6ad16675 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:19.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-40247e9a-9f69-4f4b-a20c-a1ec6ad16675 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:19.961362 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-40247e9a-9f69-4f4b-a20c-a1ec6ad16675 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:20.108983 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-40247e9a-9f69-4f4b-a20c-a1ec6ad16675 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:20.117449 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-40247e9a-9f69-4f4b-a20c-a1ec6ad16675 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.169797 Sep 05 12:23:20.117947 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 174/354] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:19 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:20.472105 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-792d473b-c0d7-4a97-8559-d4c81c656400 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:20.472906 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-792d473b-c0d7-4a97-8559-d4c81c656400 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:20.480006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-792d473b-c0d7-4a97-8559-d4c81c656400 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:20.480488 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-792d473b-c0d7-4a97-8559-d4c81c656400 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:20.480918 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-792d473b-c0d7-4a97-8559-d4c81c656400 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:20.481618 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-792d473b-c0d7-4a97-8559-d4c81c656400 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:20.482067 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-792d473b-c0d7-4a97-8559-d4c81c656400 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:20.482484 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-792d473b-c0d7-4a97-8559-d4c81c656400 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:20.622592 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-792d473b-c0d7-4a97-8559-d4c81c656400 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:20.631820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-792d473b-c0d7-4a97-8559-d4c81c656400 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.163443 Sep 05 12:23:20.632368 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 175/355] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:20 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:20.980115 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6d4a0162-56c9-480b-a049-081697f4d932 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:20.980782 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6d4a0162-56c9-480b-a049-081697f4d932 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:20.987460 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6d4a0162-56c9-480b-a049-081697f4d932 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:20.988006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6d4a0162-56c9-480b-a049-081697f4d932 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:20.988439 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6d4a0162-56c9-480b-a049-081697f4d932 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:20.989152 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6d4a0162-56c9-480b-a049-081697f4d932 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:20.989606 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6d4a0162-56c9-480b-a049-081697f4d932 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:20.990031 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6d4a0162-56c9-480b-a049-081697f4d932 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:21.057780 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6d4a0162-56c9-480b-a049-081697f4d932 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:21.071868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6d4a0162-56c9-480b-a049-081697f4d932 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.095187 Sep 05 12:23:21.072881 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 176/356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:20 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:21.140659 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0e30a0cc-f1ce-4565-95cc-3bada89ec25b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:21.141328 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0e30a0cc-f1ce-4565-95cc-3bada89ec25b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:21.148864 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0e30a0cc-f1ce-4565-95cc-3bada89ec25b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:21.149464 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0e30a0cc-f1ce-4565-95cc-3bada89ec25b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:21.149988 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0e30a0cc-f1ce-4565-95cc-3bada89ec25b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:21.151181 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0e30a0cc-f1ce-4565-95cc-3bada89ec25b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:21.151796 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0e30a0cc-f1ce-4565-95cc-3bada89ec25b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:21.152319 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0e30a0cc-f1ce-4565-95cc-3bada89ec25b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:21.324916 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0e30a0cc-f1ce-4565-95cc-3bada89ec25b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:21.333606 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0e30a0cc-f1ce-4565-95cc-3bada89ec25b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.197036 Sep 05 12:23:21.334222 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 177/357] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:21 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:21.655155 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f6b8bcb6-34fc-420c-a01a-107cb8d5c08c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:21.655832 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f6b8bcb6-34fc-420c-a01a-107cb8d5c08c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:21.662311 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f6b8bcb6-34fc-420c-a01a-107cb8d5c08c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:21.662929 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f6b8bcb6-34fc-420c-a01a-107cb8d5c08c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:21.663968 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f6b8bcb6-34fc-420c-a01a-107cb8d5c08c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:21.664839 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f6b8bcb6-34fc-420c-a01a-107cb8d5c08c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:21.665404 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f6b8bcb6-34fc-420c-a01a-107cb8d5c08c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:21.665916 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f6b8bcb6-34fc-420c-a01a-107cb8d5c08c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:21.818215 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f6b8bcb6-34fc-420c-a01a-107cb8d5c08c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:21.833261 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f6b8bcb6-34fc-420c-a01a-107cb8d5c08c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.181389 Sep 05 12:23:21.833941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 178/358] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:21 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:22.109558 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-aff64614-8ae8-4277-a1ef-f2eb04ca73d2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:22.110323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-aff64614-8ae8-4277-a1ef-f2eb04ca73d2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:22.117053 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aff64614-8ae8-4277-a1ef-f2eb04ca73d2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:22.117548 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aff64614-8ae8-4277-a1ef-f2eb04ca73d2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:22.117985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aff64614-8ae8-4277-a1ef-f2eb04ca73d2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:22.118700 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aff64614-8ae8-4277-a1ef-f2eb04ca73d2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:22.119160 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aff64614-8ae8-4277-a1ef-f2eb04ca73d2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:22.119634 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aff64614-8ae8-4277-a1ef-f2eb04ca73d2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:22.186943 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-aff64614-8ae8-4277-a1ef-f2eb04ca73d2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:22.196542 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-aff64614-8ae8-4277-a1ef-f2eb04ca73d2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.090480 Sep 05 12:23:22.197221 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 179/359] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:22 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:22.361848 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2e3d8162-73d5-4fd1-a8c6-65760e1c70e9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:22.362465 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2e3d8162-73d5-4fd1-a8c6-65760e1c70e9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:22.369476 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2e3d8162-73d5-4fd1-a8c6-65760e1c70e9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:22.370056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2e3d8162-73d5-4fd1-a8c6-65760e1c70e9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:22.370561 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2e3d8162-73d5-4fd1-a8c6-65760e1c70e9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:22.371412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2e3d8162-73d5-4fd1-a8c6-65760e1c70e9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:22.372009 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2e3d8162-73d5-4fd1-a8c6-65760e1c70e9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:22.372501 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2e3d8162-73d5-4fd1-a8c6-65760e1c70e9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:22.516620 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2e3d8162-73d5-4fd1-a8c6-65760e1c70e9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:22.525656 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2e3d8162-73d5-4fd1-a8c6-65760e1c70e9 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.167716 Sep 05 12:23:22.526250 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 180/360] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:22 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:22.857344 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c4e25d2e-f6ae-4b61-8ac0-528851768dac tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:22.858100 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c4e25d2e-f6ae-4b61-8ac0-528851768dac tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:22.864846 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c4e25d2e-f6ae-4b61-8ac0-528851768dac tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:22.865336 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c4e25d2e-f6ae-4b61-8ac0-528851768dac tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:22.865771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c4e25d2e-f6ae-4b61-8ac0-528851768dac tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:22.866996 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c4e25d2e-f6ae-4b61-8ac0-528851768dac tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:22.867454 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c4e25d2e-f6ae-4b61-8ac0-528851768dac tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:22.867907 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c4e25d2e-f6ae-4b61-8ac0-528851768dac tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:23.058413 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c4e25d2e-f6ae-4b61-8ac0-528851768dac tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:23.067047 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c4e25d2e-f6ae-4b61-8ac0-528851768dac tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.213984 Sep 05 12:23:23.067673 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 181/361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:22 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:23.221781 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ad0a6847-c238-4e7d-b88b-ba7541811f9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:23.222919 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ad0a6847-c238-4e7d-b88b-ba7541811f9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:23.230730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ad0a6847-c238-4e7d-b88b-ba7541811f9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:23.231213 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ad0a6847-c238-4e7d-b88b-ba7541811f9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:23.231679 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ad0a6847-c238-4e7d-b88b-ba7541811f9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:23.232680 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ad0a6847-c238-4e7d-b88b-ba7541811f9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:23.233611 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ad0a6847-c238-4e7d-b88b-ba7541811f9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:23.234042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ad0a6847-c238-4e7d-b88b-ba7541811f9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:23.280387 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=100 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:23.396914 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ad0a6847-c238-4e7d-b88b-ba7541811f9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:23.422790 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ad0a6847-c238-4e7d-b88b-ba7541811f9e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1205 microversion: 2.1 time: 0.204949 Sep 05 12:23:23.424368 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 182/362] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:23 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1205 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:23.551494 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c0e192e7-ca53-4761-8eae-9325ec2c2403 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:23.552277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c0e192e7-ca53-4761-8eae-9325ec2c2403 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:23.559742 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0e192e7-ca53-4761-8eae-9325ec2c2403 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:23.560822 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0e192e7-ca53-4761-8eae-9325ec2c2403 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:23.561368 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0e192e7-ca53-4761-8eae-9325ec2c2403 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:23.562197 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0e192e7-ca53-4761-8eae-9325ec2c2403 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:23.562918 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0e192e7-ca53-4761-8eae-9325ec2c2403 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:23.563468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c0e192e7-ca53-4761-8eae-9325ec2c2403 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:23.623956 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-93a95949-1a82-4c2c-a3e4-ebdacb680a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "POST /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.565513 Sep 05 12:23:23.628022 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 181/363] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Sep 5 12:23:19 2022] POST /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/os-volume_attachments => generated 194 bytes in 4571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:23:23.880534 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c0e192e7-ca53-4761-8eae-9325ec2c2403 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:23.891457 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c0e192e7-ca53-4761-8eae-9325ec2c2403 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.344797 Sep 05 12:23:23.892418 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 183/364] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:23 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:24.109789 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a67a0ded-8069-4e20-bf70-9e85f217c6c4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:24.111093 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a67a0ded-8069-4e20-bf70-9e85f217c6c4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:24.123653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a67a0ded-8069-4e20-bf70-9e85f217c6c4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:24.124465 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a67a0ded-8069-4e20-bf70-9e85f217c6c4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:24.125226 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a67a0ded-8069-4e20-bf70-9e85f217c6c4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:24.126532 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a67a0ded-8069-4e20-bf70-9e85f217c6c4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:24.127383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a67a0ded-8069-4e20-bf70-9e85f217c6c4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:24.128211 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a67a0ded-8069-4e20-bf70-9e85f217c6c4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:24.432235 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a67a0ded-8069-4e20-bf70-9e85f217c6c4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:24.447443 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a67a0ded-8069-4e20-bf70-9e85f217c6c4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.347262 Sep 05 12:23:24.448498 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 182/365] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:24 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:24.469282 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1732df2c-8298-495b-98b5-bb339ea67067 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:24.470121 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-1732df2c-8298-495b-98b5-bb339ea67067 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:24.477741 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1732df2c-8298-495b-98b5-bb339ea67067 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:24.478260 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1732df2c-8298-495b-98b5-bb339ea67067 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:24.478704 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1732df2c-8298-495b-98b5-bb339ea67067 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:24.479442 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1732df2c-8298-495b-98b5-bb339ea67067 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:24.479934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1732df2c-8298-495b-98b5-bb339ea67067 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:24.480368 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1732df2c-8298-495b-98b5-bb339ea67067 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:24.689177 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1732df2c-8298-495b-98b5-bb339ea67067 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:24.702028 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1732df2c-8298-495b-98b5-bb339ea67067 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1273 microversion: 2.1 time: 0.236506 Sep 05 12:23:24.703996 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 184/366] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:24 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:24.920686 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e8c1eb3e-b7a2-4589-a0b6-3e537ad49c0d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:24.921772 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e8c1eb3e-b7a2-4589-a0b6-3e537ad49c0d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:24.930110 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e8c1eb3e-b7a2-4589-a0b6-3e537ad49c0d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:24.930529 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e8c1eb3e-b7a2-4589-a0b6-3e537ad49c0d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:24.930969 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e8c1eb3e-b7a2-4589-a0b6-3e537ad49c0d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:24.931732 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e8c1eb3e-b7a2-4589-a0b6-3e537ad49c0d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:24.932192 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e8c1eb3e-b7a2-4589-a0b6-3e537ad49c0d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:24.932622 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e8c1eb3e-b7a2-4589-a0b6-3e537ad49c0d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:25.102695 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e8c1eb3e-b7a2-4589-a0b6-3e537ad49c0d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:25.117957 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e8c1eb3e-b7a2-4589-a0b6-3e537ad49c0d tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.201488 Sep 05 12:23:25.131788 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 183/367] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:24 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:25.480592 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4e5ade44-4836-4239-86ff-2f62265d3e6b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:25.481394 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4e5ade44-4836-4239-86ff-2f62265d3e6b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:25.490946 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e5ade44-4836-4239-86ff-2f62265d3e6b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:25.491452 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e5ade44-4836-4239-86ff-2f62265d3e6b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:25.491926 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e5ade44-4836-4239-86ff-2f62265d3e6b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:25.492670 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e5ade44-4836-4239-86ff-2f62265d3e6b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:25.493137 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e5ade44-4836-4239-86ff-2f62265d3e6b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:25.493569 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e5ade44-4836-4239-86ff-2f62265d3e6b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:25.743754 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-29962cc3-692d-412f-8fd9-88c5f39a57b6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:25.745288 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-29962cc3-692d-412f-8fd9-88c5f39a57b6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:25.755376 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-29962cc3-692d-412f-8fd9-88c5f39a57b6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:25.756739 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-29962cc3-692d-412f-8fd9-88c5f39a57b6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:25.757007 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-29962cc3-692d-412f-8fd9-88c5f39a57b6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:25.757867 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-29962cc3-692d-412f-8fd9-88c5f39a57b6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:25.758553 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-29962cc3-692d-412f-8fd9-88c5f39a57b6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:25.759155 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-29962cc3-692d-412f-8fd9-88c5f39a57b6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:25.781477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4e5ade44-4836-4239-86ff-2f62265d3e6b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:25.795169 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4e5ade44-4836-4239-86ff-2f62265d3e6b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.318372 Sep 05 12:23:25.795816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 185/368] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:25 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:25.829634 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-ba2f212d-df19-4011-a925-ac454be0b891 req-14098136-5f6d-42d0-8c2f-a0b634128d71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4181d872-fbd4-4b16-b8c2-d086dd1253b2", "tag": "935d1954-274e-487a-b68a-696df548ac2a"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:25.847828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-ba2f212d-df19-4011-a925-ac454be0b891 req-14098136-5f6d-42d0-8c2f-a0b634128d71 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:25.848660 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-ba2f212d-df19-4011-a925-ac454be0b891 req-14098136-5f6d-42d0-8c2f-a0b634128d71 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:25.849360 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-ba2f212d-df19-4011-a925-ac454be0b891 req-14098136-5f6d-42d0-8c2f-a0b634128d71 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:25.888519 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-ba2f212d-df19-4011-a925-ac454be0b891 req-14098136-5f6d-42d0-8c2f-a0b634128d71 service nova] Creating event network-changed:935d1954-274e-487a-b68a-696df548ac2a for instance 4181d872-fbd4-4b16-b8c2-d086dd1253b2 on hv-cinder-85518 Sep 05 12:23:25.897935 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-ba2f212d-df19-4011-a925-ac454be0b891 req-14098136-5f6d-42d0-8c2f-a0b634128d71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073930 Sep 05 12:23:25.899458 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 186/369] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:23:25.985711 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-29962cc3-692d-412f-8fd9-88c5f39a57b6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:26.002608 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-29962cc3-692d-412f-8fd9-88c5f39a57b6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1273 microversion: 2.1 time: 0.264524 Sep 05 12:23:26.004626 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 184/370] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:25 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1273 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:26.152986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ca332976-7325-4986-a14c-efefc5b8e49e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:26.153991 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ca332976-7325-4986-a14c-efefc5b8e49e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:26.171219 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ca332976-7325-4986-a14c-efefc5b8e49e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:26.172273 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ca332976-7325-4986-a14c-efefc5b8e49e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:26.173631 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ca332976-7325-4986-a14c-efefc5b8e49e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:26.178446 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ca332976-7325-4986-a14c-efefc5b8e49e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:26.179330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ca332976-7325-4986-a14c-efefc5b8e49e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:26.179992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ca332976-7325-4986-a14c-efefc5b8e49e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:26.482528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-86cb9674-963a-4200-a033-7288728f4933 req-d343c3ba-f8ce-4a9f-b9d1-68a9eea70a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64534ca-02f1-4369-94ac-1b50a063b870", "name": "network-vif-plugged", "status": "completed", "tag": "6949e5c9-4d88-4c61-a9fc-3ae9edcff7ae"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:26.495062 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-86cb9674-963a-4200-a033-7288728f4933 req-d343c3ba-f8ce-4a9f-b9d1-68a9eea70a13 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:26.495586 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-86cb9674-963a-4200-a033-7288728f4933 req-d343c3ba-f8ce-4a9f-b9d1-68a9eea70a13 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:26.496027 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-86cb9674-963a-4200-a033-7288728f4933 req-d343c3ba-f8ce-4a9f-b9d1-68a9eea70a13 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:26.509642 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-86cb9674-963a-4200-a033-7288728f4933 req-d343c3ba-f8ce-4a9f-b9d1-68a9eea70a13 service nova] Creating event network-vif-plugged:6949e5c9-4d88-4c61-a9fc-3ae9edcff7ae for instance f64534ca-02f1-4369-94ac-1b50a063b870 on hv-cinder-85518 Sep 05 12:23:26.514909 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-86cb9674-963a-4200-a033-7288728f4933 req-d343c3ba-f8ce-4a9f-b9d1-68a9eea70a13 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038847 Sep 05 12:23:26.515645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 185/371] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:23:26.583323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ca332976-7325-4986-a14c-efefc5b8e49e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:26.592396 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ca332976-7325-4986-a14c-efefc5b8e49e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1314 microversion: 2.1 time: 0.444600 Sep 05 12:23:26.592992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 187/372] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:26 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:26.827320 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d25a9d98-4e93-40eb-afd0-328459de0f47 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:26.827976 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d25a9d98-4e93-40eb-afd0-328459de0f47 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:26.830662 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-39aa2589-7d7f-4389-adab-f5116345bae4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:26.831315 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-39aa2589-7d7f-4389-adab-f5116345bae4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:26.834717 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d25a9d98-4e93-40eb-afd0-328459de0f47 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:26.835917 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d25a9d98-4e93-40eb-afd0-328459de0f47 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:26.836360 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d25a9d98-4e93-40eb-afd0-328459de0f47 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:26.837098 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d25a9d98-4e93-40eb-afd0-328459de0f47 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:26.837568 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d25a9d98-4e93-40eb-afd0-328459de0f47 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:26.838002 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d25a9d98-4e93-40eb-afd0-328459de0f47 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:26.838357 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-39aa2589-7d7f-4389-adab-f5116345bae4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:26.838851 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-39aa2589-7d7f-4389-adab-f5116345bae4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:26.839291 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-39aa2589-7d7f-4389-adab-f5116345bae4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:26.840046 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-39aa2589-7d7f-4389-adab-f5116345bae4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:26.840506 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-39aa2589-7d7f-4389-adab-f5116345bae4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:26.840938 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-39aa2589-7d7f-4389-adab-f5116345bae4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:26.875132 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.objects.instance [None req-d25a9d98-4e93-40eb-afd0-328459de0f47 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lazy-loading 'flavor' on Instance uuid 78cd9ae3-2a60-4905-a291-30169e41c86c {{(pid=120534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:23:27.004109 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-39aa2589-7d7f-4389-adab-f5116345bae4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:27.018195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-39aa2589-7d7f-4389-adab-f5116345bae4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.189874 Sep 05 12:23:27.019866 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 188/373] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:26 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:27.040191 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ebf1078a-bc6a-49d0-a832-195dd49aa4d4 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:27.048263 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ebf1078a-bc6a-49d0-a832-195dd49aa4d4 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:27.054967 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebf1078a-bc6a-49d0-a832-195dd49aa4d4 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:27.058399 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebf1078a-bc6a-49d0-a832-195dd49aa4d4 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:27.060545 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebf1078a-bc6a-49d0-a832-195dd49aa4d4 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:27.060545 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebf1078a-bc6a-49d0-a832-195dd49aa4d4 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:27.060545 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebf1078a-bc6a-49d0-a832-195dd49aa4d4 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:27.060915 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebf1078a-bc6a-49d0-a832-195dd49aa4d4 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:27.153546 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d25a9d98-4e93-40eb-afd0-328459de0f47 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "POST /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/action" status: 202 len: 0 microversion: 2.20 time: 0.330494 Sep 05 12:23:27.154848 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 186/374] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Sep 5 12:23:26 2022] POST /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:23:27.166571 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5cf2df16-94c4-4992-8d77-44c29ced8b3b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:27.168388 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5cf2df16-94c4-4992-8d77-44c29ced8b3b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:27.183517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5cf2df16-94c4-4992-8d77-44c29ced8b3b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:27.184305 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5cf2df16-94c4-4992-8d77-44c29ced8b3b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:27.184825 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5cf2df16-94c4-4992-8d77-44c29ced8b3b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:27.185587 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5cf2df16-94c4-4992-8d77-44c29ced8b3b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:27.186417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5cf2df16-94c4-4992-8d77-44c29ced8b3b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:27.187104 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5cf2df16-94c4-4992-8d77-44c29ced8b3b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:27.361766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5cf2df16-94c4-4992-8d77-44c29ced8b3b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:27.365726 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ebf1078a-bc6a-49d0-a832-195dd49aa4d4 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:27.372105 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5cf2df16-94c4-4992-8d77-44c29ced8b3b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:27.373738 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5cf2df16-94c4-4992-8d77-44c29ced8b3b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:27.375197 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5cf2df16-94c4-4992-8d77-44c29ced8b3b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.213842 Sep 05 12:23:27.376081 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 187/375] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:27 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:27.378943 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ebf1078a-bc6a-49d0-a832-195dd49aa4d4 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.343186 Sep 05 12:23:27.378943 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 189/376] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:27 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:27.616719 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a8bda672-1c7d-41ad-9125-634dde063df7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:27.617489 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a8bda672-1c7d-41ad-9125-634dde063df7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:27.624961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a8bda672-1c7d-41ad-9125-634dde063df7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:27.625456 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a8bda672-1c7d-41ad-9125-634dde063df7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:27.625925 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a8bda672-1c7d-41ad-9125-634dde063df7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:27.626715 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a8bda672-1c7d-41ad-9125-634dde063df7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:27.627208 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a8bda672-1c7d-41ad-9125-634dde063df7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:27.627673 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a8bda672-1c7d-41ad-9125-634dde063df7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:27.630854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:27.789989 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a8bda672-1c7d-41ad-9125-634dde063df7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:27.798401 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a8bda672-1c7d-41ad-9125-634dde063df7 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1464 microversion: 2.1 time: 0.186081 Sep 05 12:23:27.798997 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 188/377] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:27 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1464 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:27.851485 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e82edbe6-3ec5-463e-bd98-72a0e2b29484 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:27.852151 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e82edbe6-3ec5-463e-bd98-72a0e2b29484 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:27.858927 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e82edbe6-3ec5-463e-bd98-72a0e2b29484 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:27.859417 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e82edbe6-3ec5-463e-bd98-72a0e2b29484 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:27.859883 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e82edbe6-3ec5-463e-bd98-72a0e2b29484 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:27.860581 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e82edbe6-3ec5-463e-bd98-72a0e2b29484 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:27.861038 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e82edbe6-3ec5-463e-bd98-72a0e2b29484 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:27.861463 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e82edbe6-3ec5-463e-bd98-72a0e2b29484 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:27.890581 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e82edbe6-3ec5-463e-bd98-72a0e2b29484 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Going to try to terminate instance {{(pid=120535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:23:27.989137 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e82edbe6-3ec5-463e-bd98-72a0e2b29484 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 204 len: 0 microversion: 2.1 time: 0.141887 Sep 05 12:23:27.989922 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 190/378] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:23:27 2022] DELETE /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:23:27.998732 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b51357a7-90ab-4fc3-b43e-5e4354096dbe tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:27.999568 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b51357a7-90ab-4fc3-b43e-5e4354096dbe tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:28.006249 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b51357a7-90ab-4fc3-b43e-5e4354096dbe tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:28.006920 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b51357a7-90ab-4fc3-b43e-5e4354096dbe tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:28.007405 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b51357a7-90ab-4fc3-b43e-5e4354096dbe tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:28.008240 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b51357a7-90ab-4fc3-b43e-5e4354096dbe tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:28.008737 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b51357a7-90ab-4fc3-b43e-5e4354096dbe tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:28.009204 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b51357a7-90ab-4fc3-b43e-5e4354096dbe tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:28.044301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-41ad5e15-75d6-4b73-a65c-0f9fe7867908 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:28.045643 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-41ad5e15-75d6-4b73-a65c-0f9fe7867908 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:28.053771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-41ad5e15-75d6-4b73-a65c-0f9fe7867908 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:28.054470 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-41ad5e15-75d6-4b73-a65c-0f9fe7867908 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:28.055083 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-41ad5e15-75d6-4b73-a65c-0f9fe7867908 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:28.056043 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-41ad5e15-75d6-4b73-a65c-0f9fe7867908 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:28.056694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-41ad5e15-75d6-4b73-a65c-0f9fe7867908 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:28.057231 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-41ad5e15-75d6-4b73-a65c-0f9fe7867908 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:28.162830 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b51357a7-90ab-4fc3-b43e-5e4354096dbe tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:28.174039 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b51357a7-90ab-4fc3-b43e-5e4354096dbe tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1470 microversion: 2.1 time: 0.179235 Sep 05 12:23:28.174745 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 189/379] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:27 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:28.215773 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-41ad5e15-75d6-4b73-a65c-0f9fe7867908 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:28.224652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-41ad5e15-75d6-4b73-a65c-0f9fe7867908 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.185486 Sep 05 12:23:28.225560 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 191/380] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:28 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:28.290489 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f6f8e5d8-6ca0-4432-8af1-2dbdf96bc300 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:28.295795 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f6f8e5d8-6ca0-4432-8af1-2dbdf96bc300 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:28.308644 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6f8e5d8-6ca0-4432-8af1-2dbdf96bc300 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:28.309533 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6f8e5d8-6ca0-4432-8af1-2dbdf96bc300 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:28.310326 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6f8e5d8-6ca0-4432-8af1-2dbdf96bc300 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:28.311702 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6f8e5d8-6ca0-4432-8af1-2dbdf96bc300 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:28.312563 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6f8e5d8-6ca0-4432-8af1-2dbdf96bc300 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:28.313367 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6f8e5d8-6ca0-4432-8af1-2dbdf96bc300 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:28.404738 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-caebc09b-b2c5-41d2-ae53-54e85f725dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:28.405355 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-caebc09b-b2c5-41d2-ae53-54e85f725dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:28.412001 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-caebc09b-b2c5-41d2-ae53-54e85f725dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:28.412486 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-caebc09b-b2c5-41d2-ae53-54e85f725dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:28.413058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-caebc09b-b2c5-41d2-ae53-54e85f725dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:28.413691 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-caebc09b-b2c5-41d2-ae53-54e85f725dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:28.414152 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-caebc09b-b2c5-41d2-ae53-54e85f725dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:28.414578 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-caebc09b-b2c5-41d2-ae53-54e85f725dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:28.503077 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.objects.instance [None req-f6f8e5d8-6ca0-4432-8af1-2dbdf96bc300 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lazy-loading 'services' on Instance uuid 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd {{(pid=120534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:23:28.574389 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-caebc09b-b2c5-41d2-ae53-54e85f725dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:28.584203 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-caebc09b-b2c5-41d2-ae53-54e85f725dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:28.586519 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-caebc09b-b2c5-41d2-ae53-54e85f725dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:28.587961 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-caebc09b-b2c5-41d2-ae53-54e85f725dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.187473 Sep 05 12:23:28.588530 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 192/381] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:28 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:28.603836 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-75be0bfa-8cf6-472a-8e1e-b8202695daa5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:28.603836 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-75be0bfa-8cf6-472a-8e1e-b8202695daa5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:28.604589 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-75be0bfa-8cf6-472a-8e1e-b8202695daa5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:28.605089 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-75be0bfa-8cf6-472a-8e1e-b8202695daa5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:28.605519 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-75be0bfa-8cf6-472a-8e1e-b8202695daa5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:28.606225 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-75be0bfa-8cf6-472a-8e1e-b8202695daa5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:28.606679 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-75be0bfa-8cf6-472a-8e1e-b8202695daa5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:28.607133 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-75be0bfa-8cf6-472a-8e1e-b8202695daa5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:28.650141 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f6f8e5d8-6ca0-4432-8af1-2dbdf96bc300 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "DELETE /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd/os-volume_attachments/0ec62643-0af6-436a-9dde-211c0821414a" status: 202 len: 0 microversion: 2.1 time: 0.367070 Sep 05 12:23:28.650890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 190/382] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Sep 5 12:23:28 2022] DELETE /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd/os-volume_attachments/0ec62643-0af6-436a-9dde-211c0821414a => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:23:28.766349 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-75be0bfa-8cf6-472a-8e1e-b8202695daa5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:28.775059 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-75be0bfa-8cf6-472a-8e1e-b8202695daa5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.181642 Sep 05 12:23:28.775951 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 193/383] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:28 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:29.197925 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4b53cf9b-9550-450e-88b3-7f3e2a7a97f2 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:29.199335 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4b53cf9b-9550-450e-88b3-7f3e2a7a97f2 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:29.205854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4b53cf9b-9550-450e-88b3-7f3e2a7a97f2 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:29.206339 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4b53cf9b-9550-450e-88b3-7f3e2a7a97f2 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:29.206779 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4b53cf9b-9550-450e-88b3-7f3e2a7a97f2 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:29.207489 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4b53cf9b-9550-450e-88b3-7f3e2a7a97f2 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:29.207980 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4b53cf9b-9550-450e-88b3-7f3e2a7a97f2 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:29.208408 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4b53cf9b-9550-450e-88b3-7f3e2a7a97f2 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:29.249323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-98188c12-9421-4e45-ba01-e42d4277c347 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:29.250023 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-98188c12-9421-4e45-ba01-e42d4277c347 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:29.256789 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98188c12-9421-4e45-ba01-e42d4277c347 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:29.257270 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98188c12-9421-4e45-ba01-e42d4277c347 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:29.257732 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98188c12-9421-4e45-ba01-e42d4277c347 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:29.260164 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98188c12-9421-4e45-ba01-e42d4277c347 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:29.260721 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98188c12-9421-4e45-ba01-e42d4277c347 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:29.261232 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98188c12-9421-4e45-ba01-e42d4277c347 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:29.368326 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4b53cf9b-9550-450e-88b3-7f3e2a7a97f2 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:29.377177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4b53cf9b-9550-450e-88b3-7f3e2a7a97f2 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1470 microversion: 2.1 time: 0.183421 Sep 05 12:23:29.377764 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 191/384] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:29 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1470 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:29.408486 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-98188c12-9421-4e45-ba01-e42d4277c347 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:29.416693 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-98188c12-9421-4e45-ba01-e42d4277c347 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.171658 Sep 05 12:23:29.417288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 194/385] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:29 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:29.623124 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-14d69594-f596-4eaf-b17f-93d79aa20eaa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:29.626239 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-14d69594-f596-4eaf-b17f-93d79aa20eaa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:29.644776 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-14d69594-f596-4eaf-b17f-93d79aa20eaa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:29.646622 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-14d69594-f596-4eaf-b17f-93d79aa20eaa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:29.647991 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-14d69594-f596-4eaf-b17f-93d79aa20eaa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:29.650018 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-14d69594-f596-4eaf-b17f-93d79aa20eaa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:29.651229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-14d69594-f596-4eaf-b17f-93d79aa20eaa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:29.652058 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-14d69594-f596-4eaf-b17f-93d79aa20eaa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:29.804393 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d6fa3bce-05f8-4993-9ad3-4a6754d45b4a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:29.804393 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d6fa3bce-05f8-4993-9ad3-4a6754d45b4a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:29.804393 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:29.808203 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d6fa3bce-05f8-4993-9ad3-4a6754d45b4a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:29.808990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d6fa3bce-05f8-4993-9ad3-4a6754d45b4a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:29.809613 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d6fa3bce-05f8-4993-9ad3-4a6754d45b4a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:29.810331 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d6fa3bce-05f8-4993-9ad3-4a6754d45b4a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:29.810774 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d6fa3bce-05f8-4993-9ad3-4a6754d45b4a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:29.811374 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d6fa3bce-05f8-4993-9ad3-4a6754d45b4a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:29.835731 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-14d69594-f596-4eaf-b17f-93d79aa20eaa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:29.851746 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-14d69594-f596-4eaf-b17f-93d79aa20eaa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:29.853193 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-14d69594-f596-4eaf-b17f-93d79aa20eaa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:29.854401 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-14d69594-f596-4eaf-b17f-93d79aa20eaa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.241415 Sep 05 12:23:29.854969 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 192/386] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:29 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:29.958103 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d6fa3bce-05f8-4993-9ad3-4a6754d45b4a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:29.966080 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d6fa3bce-05f8-4993-9ad3-4a6754d45b4a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.171618 Sep 05 12:23:29.966641 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 195/387] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:29 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:30.402858 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-894c4b58-63ea-49f6-b502-b64f86cafac3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:30.404188 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-894c4b58-63ea-49f6-b502-b64f86cafac3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:30.411160 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-894c4b58-63ea-49f6-b502-b64f86cafac3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:30.411374 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-894c4b58-63ea-49f6-b502-b64f86cafac3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:30.411950 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-894c4b58-63ea-49f6-b502-b64f86cafac3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:30.413627 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-894c4b58-63ea-49f6-b502-b64f86cafac3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:30.414093 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-894c4b58-63ea-49f6-b502-b64f86cafac3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:30.414515 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-894c4b58-63ea-49f6-b502-b64f86cafac3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:30.440184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9f283b99-1119-40be-8108-47a470559700 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:30.440789 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-9f283b99-1119-40be-8108-47a470559700 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:30.447992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9f283b99-1119-40be-8108-47a470559700 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:30.448496 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9f283b99-1119-40be-8108-47a470559700 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:30.448927 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9f283b99-1119-40be-8108-47a470559700 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:30.449622 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9f283b99-1119-40be-8108-47a470559700 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:30.450090 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9f283b99-1119-40be-8108-47a470559700 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:30.450503 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9f283b99-1119-40be-8108-47a470559700 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:30.552898 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-894c4b58-63ea-49f6-b502-b64f86cafac3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:30.561140 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-894c4b58-63ea-49f6-b502-b64f86cafac3 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1470 microversion: 2.1 time: 0.163727 Sep 05 12:23:30.561970 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 193/388] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:30 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:30.597238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-9f283b99-1119-40be-8108-47a470559700 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:30.605327 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9f283b99-1119-40be-8108-47a470559700 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.168965 Sep 05 12:23:30.605913 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 196/389] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:30 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:30.880274 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3aedc143-10bf-40e6-9917-7211ad29cc8c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:30.881418 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-3aedc143-10bf-40e6-9917-7211ad29cc8c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:30.888474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3aedc143-10bf-40e6-9917-7211ad29cc8c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:30.888959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3aedc143-10bf-40e6-9917-7211ad29cc8c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:30.889388 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3aedc143-10bf-40e6-9917-7211ad29cc8c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:30.890094 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3aedc143-10bf-40e6-9917-7211ad29cc8c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:30.890544 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3aedc143-10bf-40e6-9917-7211ad29cc8c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:30.890965 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3aedc143-10bf-40e6-9917-7211ad29cc8c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:30.990092 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-969e134d-b135-48b9-b350-102a4ddc4938 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:30.990725 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-969e134d-b135-48b9-b350-102a4ddc4938 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:30.997563 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-969e134d-b135-48b9-b350-102a4ddc4938 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:30.998053 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-969e134d-b135-48b9-b350-102a4ddc4938 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:30.998488 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-969e134d-b135-48b9-b350-102a4ddc4938 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:30.999207 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-969e134d-b135-48b9-b350-102a4ddc4938 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:30.999731 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-969e134d-b135-48b9-b350-102a4ddc4938 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:31.000189 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-969e134d-b135-48b9-b350-102a4ddc4938 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:31.035172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-3aedc143-10bf-40e6-9917-7211ad29cc8c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:31.046791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-3aedc143-10bf-40e6-9917-7211ad29cc8c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:31.048293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-3aedc143-10bf-40e6-9917-7211ad29cc8c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:31.049650 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-3aedc143-10bf-40e6-9917-7211ad29cc8c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.173114 Sep 05 12:23:31.050099 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 194/390] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:30 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:31.148371 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-969e134d-b135-48b9-b350-102a4ddc4938 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:31.156759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-969e134d-b135-48b9-b350-102a4ddc4938 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.171325 Sep 05 12:23:31.157351 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 197/391] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:30 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:31.584893 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-16277936-fb67-4c64-ace9-6030dd20b74c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:31.585627 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-16277936-fb67-4c64-ace9-6030dd20b74c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:31.591971 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16277936-fb67-4c64-ace9-6030dd20b74c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:31.592470 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16277936-fb67-4c64-ace9-6030dd20b74c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:31.592911 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16277936-fb67-4c64-ace9-6030dd20b74c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:31.593636 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16277936-fb67-4c64-ace9-6030dd20b74c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:31.594093 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16277936-fb67-4c64-ace9-6030dd20b74c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:31.594524 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16277936-fb67-4c64-ace9-6030dd20b74c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:31.627799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-baa80f2a-db09-4307-a9e5-9d8f60e335bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:31.628601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-baa80f2a-db09-4307-a9e5-9d8f60e335bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:31.637685 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-baa80f2a-db09-4307-a9e5-9d8f60e335bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:31.638540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-baa80f2a-db09-4307-a9e5-9d8f60e335bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:31.639295 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-baa80f2a-db09-4307-a9e5-9d8f60e335bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:31.640584 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-baa80f2a-db09-4307-a9e5-9d8f60e335bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:31.641393 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-baa80f2a-db09-4307-a9e5-9d8f60e335bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:31.642024 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-baa80f2a-db09-4307-a9e5-9d8f60e335bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:31.648511 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:31.765665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-16277936-fb67-4c64-ace9-6030dd20b74c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:31.774151 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-16277936-fb67-4c64-ace9-6030dd20b74c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1470 microversion: 2.1 time: 0.193157 Sep 05 12:23:31.774741 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 195/392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:31 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:31.814321 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-baa80f2a-db09-4307-a9e5-9d8f60e335bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:31.822324 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-baa80f2a-db09-4307-a9e5-9d8f60e335bc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.198386 Sep 05 12:23:31.822912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 198/393] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:31 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:32.075577 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-25be2323-ed10-4ad7-9572-ffcec35e07e4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:32.076345 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-25be2323-ed10-4ad7-9572-ffcec35e07e4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:32.083010 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-25be2323-ed10-4ad7-9572-ffcec35e07e4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:32.083499 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-25be2323-ed10-4ad7-9572-ffcec35e07e4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:32.083969 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-25be2323-ed10-4ad7-9572-ffcec35e07e4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:32.084823 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-25be2323-ed10-4ad7-9572-ffcec35e07e4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:32.085777 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-25be2323-ed10-4ad7-9572-ffcec35e07e4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:32.086238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-25be2323-ed10-4ad7-9572-ffcec35e07e4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:32.180729 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8072f0f6-da27-41f3-80d4-84b49788395d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:32.181511 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8072f0f6-da27-41f3-80d4-84b49788395d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:32.192788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8072f0f6-da27-41f3-80d4-84b49788395d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:32.193521 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8072f0f6-da27-41f3-80d4-84b49788395d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:32.194926 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8072f0f6-da27-41f3-80d4-84b49788395d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:32.196108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8072f0f6-da27-41f3-80d4-84b49788395d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:32.196579 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8072f0f6-da27-41f3-80d4-84b49788395d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:32.197553 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8072f0f6-da27-41f3-80d4-84b49788395d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:32.229415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-25be2323-ed10-4ad7-9572-ffcec35e07e4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:32.238111 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-25be2323-ed10-4ad7-9572-ffcec35e07e4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:32.239594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-25be2323-ed10-4ad7-9572-ffcec35e07e4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:32.240794 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-25be2323-ed10-4ad7-9572-ffcec35e07e4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.169330 Sep 05 12:23:32.241406 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 196/394] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:32 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:32.396446 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8072f0f6-da27-41f3-80d4-84b49788395d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:32.406650 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8072f0f6-da27-41f3-80d4-84b49788395d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.229966 Sep 05 12:23:32.407416 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 199/395] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:32 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:32.798642 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f9098875-5d89-4450-af5a-a6b8ee9cd0ed tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:32.799384 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f9098875-5d89-4450-af5a-a6b8ee9cd0ed tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:32.806298 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9098875-5d89-4450-af5a-a6b8ee9cd0ed tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:32.806776 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9098875-5d89-4450-af5a-a6b8ee9cd0ed tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:32.807213 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9098875-5d89-4450-af5a-a6b8ee9cd0ed tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:32.807938 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9098875-5d89-4450-af5a-a6b8ee9cd0ed tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:32.808396 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9098875-5d89-4450-af5a-a6b8ee9cd0ed tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:32.808825 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9098875-5d89-4450-af5a-a6b8ee9cd0ed tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:32.848951 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9b83e57c-0263-4514-9e2e-30f6af7d100a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:32.850048 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-9b83e57c-0263-4514-9e2e-30f6af7d100a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:32.862479 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9b83e57c-0263-4514-9e2e-30f6af7d100a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:32.863334 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9b83e57c-0263-4514-9e2e-30f6af7d100a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:32.864167 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9b83e57c-0263-4514-9e2e-30f6af7d100a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:32.865072 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9b83e57c-0263-4514-9e2e-30f6af7d100a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:32.865551 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9b83e57c-0263-4514-9e2e-30f6af7d100a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:32.866007 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9b83e57c-0263-4514-9e2e-30f6af7d100a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:32.955871 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f9098875-5d89-4450-af5a-a6b8ee9cd0ed tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:32.964234 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f9098875-5d89-4450-af5a-a6b8ee9cd0ed tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1470 microversion: 2.1 time: 0.169609 Sep 05 12:23:32.964830 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 197/396] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:32 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:33.044522 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-9b83e57c-0263-4514-9e2e-30f6af7d100a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:33.052691 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9b83e57c-0263-4514-9e2e-30f6af7d100a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1370 microversion: 2.1 time: 0.210091 Sep 05 12:23:33.053200 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 200/397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:32 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:33.266525 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ff43ca9e-5486-422c-b945-bbefa94a3562 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:33.267149 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ff43ca9e-5486-422c-b945-bbefa94a3562 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:33.274427 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ff43ca9e-5486-422c-b945-bbefa94a3562 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:33.274915 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ff43ca9e-5486-422c-b945-bbefa94a3562 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:33.275636 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ff43ca9e-5486-422c-b945-bbefa94a3562 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:33.276343 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ff43ca9e-5486-422c-b945-bbefa94a3562 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:33.276804 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ff43ca9e-5486-422c-b945-bbefa94a3562 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:33.277235 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ff43ca9e-5486-422c-b945-bbefa94a3562 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:33.415157 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ff43ca9e-5486-422c-b945-bbefa94a3562 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:33.423712 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ff43ca9e-5486-422c-b945-bbefa94a3562 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:33.425147 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ff43ca9e-5486-422c-b945-bbefa94a3562 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:33.426405 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ff43ca9e-5486-422c-b945-bbefa94a3562 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.163793 Sep 05 12:23:33.426974 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 198/398] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:33 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:33.431886 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5f12bde8-2637-4397-97a8-022dc020b556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:33.432719 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5f12bde8-2637-4397-97a8-022dc020b556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:33.440441 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5f12bde8-2637-4397-97a8-022dc020b556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:33.441180 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5f12bde8-2637-4397-97a8-022dc020b556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:33.441827 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5f12bde8-2637-4397-97a8-022dc020b556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:33.442814 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5f12bde8-2637-4397-97a8-022dc020b556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:33.443484 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5f12bde8-2637-4397-97a8-022dc020b556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:33.444178 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5f12bde8-2637-4397-97a8-022dc020b556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:33.598846 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5f12bde8-2637-4397-97a8-022dc020b556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:33.611251 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5f12bde8-2637-4397-97a8-022dc020b556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.183223 Sep 05 12:23:33.611788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 201/399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:33 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:33.711373 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c5b92b64-13ce-46c5-b7ab-04847d2a5421 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:33.717491 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c5b92b64-13ce-46c5-b7ab-04847d2a5421 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:33.717981 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c5b92b64-13ce-46c5-b7ab-04847d2a5421 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:33.718419 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c5b92b64-13ce-46c5-b7ab-04847d2a5421 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:33.780920 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c5b92b64-13ce-46c5-b7ab-04847d2a5421 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Going to try to stop instance {{(pid=120534) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 05 12:23:33.824844 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c5b92b64-13ce-46c5-b7ab-04847d2a5421 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "POST /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/action" status: 202 len: 0 microversion: 2.1 time: 0.117864 Sep 05 12:23:33.825504 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 199/400] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Sep 5 12:23:33 2022] POST /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:23:33.833477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e9434303-3b32-4fa1-a9b9-3bad2e186185 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:33.834079 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e9434303-3b32-4fa1-a9b9-3bad2e186185 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:33.840554 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9434303-3b32-4fa1-a9b9-3bad2e186185 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:33.841031 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9434303-3b32-4fa1-a9b9-3bad2e186185 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:33.841460 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9434303-3b32-4fa1-a9b9-3bad2e186185 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:33.842146 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9434303-3b32-4fa1-a9b9-3bad2e186185 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:33.842593 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9434303-3b32-4fa1-a9b9-3bad2e186185 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:33.843010 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9434303-3b32-4fa1-a9b9-3bad2e186185 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:33.978013 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e9434303-3b32-4fa1-a9b9-3bad2e186185 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:33.986262 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e9434303-3b32-4fa1-a9b9-3bad2e186185 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.156594 Sep 05 12:23:33.986842 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 202/401] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:33 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:33.988437 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ad115510-fcfa-4aa5-9d4d-54cb5428ee42 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:33.989130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ad115510-fcfa-4aa5-9d4d-54cb5428ee42 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:33.995756 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ad115510-fcfa-4aa5-9d4d-54cb5428ee42 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:33.996234 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ad115510-fcfa-4aa5-9d4d-54cb5428ee42 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:33.996663 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ad115510-fcfa-4aa5-9d4d-54cb5428ee42 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:33.997346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ad115510-fcfa-4aa5-9d4d-54cb5428ee42 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:33.997797 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ad115510-fcfa-4aa5-9d4d-54cb5428ee42 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:33.998221 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ad115510-fcfa-4aa5-9d4d-54cb5428ee42 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:34.077312 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-baffbaf7-5672-4c90-8b77-4ca4bdf005a6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:34.078534 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-baffbaf7-5672-4c90-8b77-4ca4bdf005a6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:34.093662 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-baffbaf7-5672-4c90-8b77-4ca4bdf005a6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:34.094340 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-baffbaf7-5672-4c90-8b77-4ca4bdf005a6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:34.094786 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-baffbaf7-5672-4c90-8b77-4ca4bdf005a6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:34.097198 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-baffbaf7-5672-4c90-8b77-4ca4bdf005a6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:34.097736 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-baffbaf7-5672-4c90-8b77-4ca4bdf005a6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:34.098106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-baffbaf7-5672-4c90-8b77-4ca4bdf005a6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:34.143254 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ad115510-fcfa-4aa5-9d4d-54cb5428ee42 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:34.151878 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ad115510-fcfa-4aa5-9d4d-54cb5428ee42 tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1470 microversion: 2.1 time: 0.167477 Sep 05 12:23:34.152473 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 200/402] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:33 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:34.179588 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-00f97990-0d3c-4f5a-a682-d24f860ee105 req-6fe64151-4ffb-4dfc-a61f-87fda450014b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c7311ba-3cf9-456b-a954-a3c8bdda4b6c", "name": "network-vif-unplugged", "status": "completed", "tag": "96326a8d-b87a-4d41-bf8f-f4b3cd06b076"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:34.189316 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:34.192206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-00f97990-0d3c-4f5a-a682-d24f860ee105 req-6fe64151-4ffb-4dfc-a61f-87fda450014b service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:34.192762 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-00f97990-0d3c-4f5a-a682-d24f860ee105 req-6fe64151-4ffb-4dfc-a61f-87fda450014b service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:34.193264 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-00f97990-0d3c-4f5a-a682-d24f860ee105 req-6fe64151-4ffb-4dfc-a61f-87fda450014b service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:34.207136 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-00f97990-0d3c-4f5a-a682-d24f860ee105 req-6fe64151-4ffb-4dfc-a61f-87fda450014b service nova] Creating event network-vif-unplugged:96326a8d-b87a-4d41-bf8f-f4b3cd06b076 for instance 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c on hv-cinder-85518 Sep 05 12:23:34.212582 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-00f97990-0d3c-4f5a-a682-d24f860ee105 req-6fe64151-4ffb-4dfc-a61f-87fda450014b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039090 Sep 05 12:23:34.213468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 201/403] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:23:34.267990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-baffbaf7-5672-4c90-8b77-4ca4bdf005a6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:34.276441 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-baffbaf7-5672-4c90-8b77-4ca4bdf005a6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1563 microversion: 2.1 time: 0.203735 Sep 05 12:23:34.277036 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 203/404] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:34 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1563 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:34.302800 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-50ace5f4-efaf-4336-ab76-83e91ddadfba tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:34.304139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-50ace5f4-efaf-4336-ab76-83e91ddadfba tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:34.313145 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-50ace5f4-efaf-4336-ab76-83e91ddadfba tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:34.313638 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-50ace5f4-efaf-4336-ab76-83e91ddadfba tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:34.314097 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-50ace5f4-efaf-4336-ab76-83e91ddadfba tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:34.315492 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-50ace5f4-efaf-4336-ab76-83e91ddadfba tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:34.316011 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-50ace5f4-efaf-4336-ab76-83e91ddadfba tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:34.316490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-50ace5f4-efaf-4336-ab76-83e91ddadfba tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:34.453048 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-010f03b3-12f9-4d6d-96d1-b7daa4e9e36c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:34.453935 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-010f03b3-12f9-4d6d-96d1-b7daa4e9e36c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:34.462263 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-010f03b3-12f9-4d6d-96d1-b7daa4e9e36c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:34.464176 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-010f03b3-12f9-4d6d-96d1-b7daa4e9e36c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:34.466700 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-010f03b3-12f9-4d6d-96d1-b7daa4e9e36c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:34.467729 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-010f03b3-12f9-4d6d-96d1-b7daa4e9e36c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:34.471764 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-010f03b3-12f9-4d6d-96d1-b7daa4e9e36c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:34.473279 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-010f03b3-12f9-4d6d-96d1-b7daa4e9e36c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:34.502021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-50ace5f4-efaf-4336-ab76-83e91ddadfba tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.205651 Sep 05 12:23:34.510481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 202/405] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Sep 5 12:23:34 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:23:34.635927 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7aa8b6b4-274a-4d5a-b0d8-99e58d4eec9a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:34.636557 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7aa8b6b4-274a-4d5a-b0d8-99e58d4eec9a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:34.642821 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7aa8b6b4-274a-4d5a-b0d8-99e58d4eec9a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:34.643319 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7aa8b6b4-274a-4d5a-b0d8-99e58d4eec9a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:34.643801 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7aa8b6b4-274a-4d5a-b0d8-99e58d4eec9a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:34.644526 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7aa8b6b4-274a-4d5a-b0d8-99e58d4eec9a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:34.644986 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7aa8b6b4-274a-4d5a-b0d8-99e58d4eec9a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:34.645449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7aa8b6b4-274a-4d5a-b0d8-99e58d4eec9a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:34.853286 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7aa8b6b4-274a-4d5a-b0d8-99e58d4eec9a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:34.862248 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7aa8b6b4-274a-4d5a-b0d8-99e58d4eec9a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.230650 Sep 05 12:23:34.863253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 203/406] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:34 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:34.885276 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-010f03b3-12f9-4d6d-96d1-b7daa4e9e36c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:34.905543 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-010f03b3-12f9-4d6d-96d1-b7daa4e9e36c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:34.909290 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-010f03b3-12f9-4d6d-96d1-b7daa4e9e36c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:34.913012 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-010f03b3-12f9-4d6d-96d1-b7daa4e9e36c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.463473 Sep 05 12:23:34.915395 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 204/407] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:34 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:35.013806 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-907be529-bb42-48d9-a5ca-438a66b8c4fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:35.014973 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-907be529-bb42-48d9-a5ca-438a66b8c4fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:35.029865 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-907be529-bb42-48d9-a5ca-438a66b8c4fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:35.030661 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-907be529-bb42-48d9-a5ca-438a66b8c4fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:35.031443 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-907be529-bb42-48d9-a5ca-438a66b8c4fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:35.032903 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-4506cd1e-ecf8-4eb2-9d10-17c845686179 req-089f5d74-ae12-4552-ad44-14d89652b6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c7311ba-3cf9-456b-a954-a3c8bdda4b6c", "name": "network-vif-deleted", "tag": "96326a8d-b87a-4d41-bf8f-f4b3cd06b076"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:35.033396 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-907be529-bb42-48d9-a5ca-438a66b8c4fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:35.033848 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-907be529-bb42-48d9-a5ca-438a66b8c4fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:35.034841 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-907be529-bb42-48d9-a5ca-438a66b8c4fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:35.049254 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:35.074402 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-4506cd1e-ecf8-4eb2-9d10-17c845686179 req-089f5d74-ae12-4552-ad44-14d89652b6df service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:35.077056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-4506cd1e-ecf8-4eb2-9d10-17c845686179 req-089f5d74-ae12-4552-ad44-14d89652b6df service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:35.077794 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-4506cd1e-ecf8-4eb2-9d10-17c845686179 req-089f5d74-ae12-4552-ad44-14d89652b6df service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:35.104049 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-4506cd1e-ecf8-4eb2-9d10-17c845686179 req-089f5d74-ae12-4552-ad44-14d89652b6df service nova] Creating event network-vif-deleted:96326a8d-b87a-4d41-bf8f-f4b3cd06b076 for instance 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c on hv-cinder-85518 Sep 05 12:23:35.135302 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-4506cd1e-ecf8-4eb2-9d10-17c845686179 req-089f5d74-ae12-4552-ad44-14d89652b6df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105387 Sep 05 12:23:35.140747 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 205/408] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:23:35.176311 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e4957d78-e070-46f1-bd63-1f4aa77e032b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:35.177123 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e4957d78-e070-46f1-bd63-1f4aa77e032b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:35.194286 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e4957d78-e070-46f1-bd63-1f4aa77e032b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:35.194797 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e4957d78-e070-46f1-bd63-1f4aa77e032b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:35.195247 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e4957d78-e070-46f1-bd63-1f4aa77e032b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:35.200990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e4957d78-e070-46f1-bd63-1f4aa77e032b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:35.201167 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e4957d78-e070-46f1-bd63-1f4aa77e032b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:35.201920 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e4957d78-e070-46f1-bd63-1f4aa77e032b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:35.304876 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-907be529-bb42-48d9-a5ca-438a66b8c4fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:35.315130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-907be529-bb42-48d9-a5ca-438a66b8c4fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.308538 Sep 05 12:23:35.327740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 204/409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:35 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:35.327740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-6aefddeb-9537-4a7a-a5e0-7340ecf4c602 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:35.327740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-6aefddeb-9537-4a7a-a5e0-7340ecf4c602 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:35.328677 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6aefddeb-9537-4a7a-a5e0-7340ecf4c602 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:35.328997 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6aefddeb-9537-4a7a-a5e0-7340ecf4c602 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:35.330151 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6aefddeb-9537-4a7a-a5e0-7340ecf4c602 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:35.333194 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6aefddeb-9537-4a7a-a5e0-7340ecf4c602 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:35.333194 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6aefddeb-9537-4a7a-a5e0-7340ecf4c602 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:35.333194 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6aefddeb-9537-4a7a-a5e0-7340ecf4c602 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:35.363054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-6aefddeb-9537-4a7a-a5e0-7340ecf4c602 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Going to try to terminate instance {{(pid=120534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:23:35.402874 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e4957d78-e070-46f1-bd63-1f4aa77e032b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:35.412644 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e4957d78-e070-46f1-bd63-1f4aa77e032b tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1299 microversion: 2.1 time: 0.241468 Sep 05 12:23:35.419712 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 206/410] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:35 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1299 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:35.462870 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-6aefddeb-9537-4a7a-a5e0-7340ecf4c602 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "DELETE /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 204 len: 0 microversion: 2.1 time: 0.145264 Sep 05 12:23:35.463466 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 205/411] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:23:35 2022] DELETE /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:23:35.473147 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8918f950-a24f-4d75-a450-eaf2fd48711a tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:35.474202 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8918f950-a24f-4d75-a450-eaf2fd48711a tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:35.483304 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8918f950-a24f-4d75-a450-eaf2fd48711a tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:35.483827 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8918f950-a24f-4d75-a450-eaf2fd48711a tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:35.484264 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8918f950-a24f-4d75-a450-eaf2fd48711a tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:35.484967 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8918f950-a24f-4d75-a450-eaf2fd48711a tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:35.485423 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8918f950-a24f-4d75-a450-eaf2fd48711a tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:35.485882 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8918f950-a24f-4d75-a450-eaf2fd48711a tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:35.787668 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8918f950-a24f-4d75-a450-eaf2fd48711a tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:35.796187 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8918f950-a24f-4d75-a450-eaf2fd48711a tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1515 microversion: 2.1 time: 0.328133 Sep 05 12:23:35.796833 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 207/412] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:35 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1515 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:35.887623 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-322a32c0-cb87-4e81-ad99-12c72fe18d01 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:35.888318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-322a32c0-cb87-4e81-ad99-12c72fe18d01 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:35.894686 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-322a32c0-cb87-4e81-ad99-12c72fe18d01 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:35.895173 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-322a32c0-cb87-4e81-ad99-12c72fe18d01 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:35.895633 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-322a32c0-cb87-4e81-ad99-12c72fe18d01 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:35.896335 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-322a32c0-cb87-4e81-ad99-12c72fe18d01 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:35.896781 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-322a32c0-cb87-4e81-ad99-12c72fe18d01 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:35.897203 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-322a32c0-cb87-4e81-ad99-12c72fe18d01 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:35.941704 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-406b18a8-c8cd-4f54-8537-49aab4472105 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:35.942303 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-406b18a8-c8cd-4f54-8537-49aab4472105 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:35.951586 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-406b18a8-c8cd-4f54-8537-49aab4472105 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:35.951586 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-406b18a8-c8cd-4f54-8537-49aab4472105 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:35.951586 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-406b18a8-c8cd-4f54-8537-49aab4472105 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:35.951586 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-406b18a8-c8cd-4f54-8537-49aab4472105 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:35.952042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-406b18a8-c8cd-4f54-8537-49aab4472105 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:35.952157 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-406b18a8-c8cd-4f54-8537-49aab4472105 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:36.055972 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-322a32c0-cb87-4e81-ad99-12c72fe18d01 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:36.063960 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-322a32c0-cb87-4e81-ad99-12c72fe18d01 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.180690 Sep 05 12:23:36.064552 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 206/413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:35 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:36.276104 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-406b18a8-c8cd-4f54-8537-49aab4472105 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:36.285093 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-406b18a8-c8cd-4f54-8537-49aab4472105 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:36.286593 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-406b18a8-c8cd-4f54-8537-49aab4472105 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:36.287848 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-406b18a8-c8cd-4f54-8537-49aab4472105 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.350025 Sep 05 12:23:36.288432 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 208/414] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:35 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:23:36.341911 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c8c7ca14-2152-4de4-ac96-a80b93df6275 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:36.342580 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c8c7ca14-2152-4de4-ac96-a80b93df6275 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:36.349578 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c8c7ca14-2152-4de4-ac96-a80b93df6275 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:36.350068 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c8c7ca14-2152-4de4-ac96-a80b93df6275 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:36.350582 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c8c7ca14-2152-4de4-ac96-a80b93df6275 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:36.351470 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c8c7ca14-2152-4de4-ac96-a80b93df6275 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:36.352116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c8c7ca14-2152-4de4-ac96-a80b93df6275 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:36.352552 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c8c7ca14-2152-4de4-ac96-a80b93df6275 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:36.437729 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-17b3e371-5dd0-4ca8-9f14-50e062deef3c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:36.438236 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-17b3e371-5dd0-4ca8-9f14-50e062deef3c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:36.446354 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-17b3e371-5dd0-4ca8-9f14-50e062deef3c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:36.446852 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-17b3e371-5dd0-4ca8-9f14-50e062deef3c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:36.447290 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-17b3e371-5dd0-4ca8-9f14-50e062deef3c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:36.448181 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-17b3e371-5dd0-4ca8-9f14-50e062deef3c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:36.449314 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-17b3e371-5dd0-4ca8-9f14-50e062deef3c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:36.450255 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-17b3e371-5dd0-4ca8-9f14-50e062deef3c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:36.486360 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-17b3e371-5dd0-4ca8-9f14-50e062deef3c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:36.486852 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-17b3e371-5dd0-4ca8-9f14-50e062deef3c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:36.487478 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-17b3e371-5dd0-4ca8-9f14-50e062deef3c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:36.488159 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-17b3e371-5dd0-4ca8-9f14-50e062deef3c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lazy-loading 'fault' on Instance uuid 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:23:36.522789 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c8c7ca14-2152-4de4-ac96-a80b93df6275 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:36.532527 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c8c7ca14-2152-4de4-ac96-a80b93df6275 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.194960 Sep 05 12:23:36.533135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 207/415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:36 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:36.573211 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-17b3e371-5dd0-4ca8-9f14-50e062deef3c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:36.581880 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-17b3e371-5dd0-4ca8-9f14-50e062deef3c tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1304 microversion: 2.1 time: 0.148036 Sep 05 12:23:36.582478 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 209/416] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:36 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1304 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:36.748400 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-8c987303-1c7b-4012-b4f0-713128c6d773 req-498078fd-2e0c-43b7-9f48-b9ff0aed720d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64534ca-02f1-4369-94ac-1b50a063b870", "tag": "6949e5c9-4d88-4c61-a9fc-3ae9edcff7ae"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:36.759138 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-8c987303-1c7b-4012-b4f0-713128c6d773 req-498078fd-2e0c-43b7-9f48-b9ff0aed720d service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:36.759669 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-8c987303-1c7b-4012-b4f0-713128c6d773 req-498078fd-2e0c-43b7-9f48-b9ff0aed720d service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:36.760094 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-8c987303-1c7b-4012-b4f0-713128c6d773 req-498078fd-2e0c-43b7-9f48-b9ff0aed720d service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:36.771976 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-8c987303-1c7b-4012-b4f0-713128c6d773 req-498078fd-2e0c-43b7-9f48-b9ff0aed720d service nova] Creating event network-changed:6949e5c9-4d88-4c61-a9fc-3ae9edcff7ae for instance f64534ca-02f1-4369-94ac-1b50a063b870 on hv-cinder-85518 Sep 05 12:23:36.777836 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-8c987303-1c7b-4012-b4f0-713128c6d773 req-498078fd-2e0c-43b7-9f48-b9ff0aed720d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034402 Sep 05 12:23:36.778440 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 208/417] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:23:36.823904 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-56100b9b-55e9-49bd-bdc6-0ef01864f7bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:36.824980 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-56100b9b-55e9-49bd-bdc6-0ef01864f7bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:36.835362 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-56100b9b-55e9-49bd-bdc6-0ef01864f7bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:36.835972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-56100b9b-55e9-49bd-bdc6-0ef01864f7bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:36.836722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-56100b9b-55e9-49bd-bdc6-0ef01864f7bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:36.837973 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-56100b9b-55e9-49bd-bdc6-0ef01864f7bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:36.838779 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-56100b9b-55e9-49bd-bdc6-0ef01864f7bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:36.839577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-56100b9b-55e9-49bd-bdc6-0ef01864f7bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:36.987507 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-56100b9b-55e9-49bd-bdc6-0ef01864f7bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:36.997200 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-56100b9b-55e9-49bd-bdc6-0ef01864f7bf tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1515 microversion: 2.1 time: 0.181125 Sep 05 12:23:36.998026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 210/418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:36 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:37.088668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0847609b-555d-4aa5-a16d-88c0a2aaf092 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:37.089270 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0847609b-555d-4aa5-a16d-88c0a2aaf092 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:37.095226 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0847609b-555d-4aa5-a16d-88c0a2aaf092 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:37.095750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0847609b-555d-4aa5-a16d-88c0a2aaf092 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:37.096198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0847609b-555d-4aa5-a16d-88c0a2aaf092 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:37.096900 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0847609b-555d-4aa5-a16d-88c0a2aaf092 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:37.097353 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0847609b-555d-4aa5-a16d-88c0a2aaf092 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:37.097784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0847609b-555d-4aa5-a16d-88c0a2aaf092 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:37.243113 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0847609b-555d-4aa5-a16d-88c0a2aaf092 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:37.252116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0847609b-555d-4aa5-a16d-88c0a2aaf092 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.168581 Sep 05 12:23:37.252769 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 209/419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:37 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:37.331001 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5998ec70-3af0-46d1-b3f2-51ef77e8ea9d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:37.332600 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5998ec70-3af0-46d1-b3f2-51ef77e8ea9d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:37.342317 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5998ec70-3af0-46d1-b3f2-51ef77e8ea9d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:37.343052 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5998ec70-3af0-46d1-b3f2-51ef77e8ea9d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:37.344641 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5998ec70-3af0-46d1-b3f2-51ef77e8ea9d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:37.345535 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5998ec70-3af0-46d1-b3f2-51ef77e8ea9d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:37.346162 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5998ec70-3af0-46d1-b3f2-51ef77e8ea9d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:37.347290 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5998ec70-3af0-46d1-b3f2-51ef77e8ea9d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:37.548418 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5998ec70-3af0-46d1-b3f2-51ef77e8ea9d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:37.557292 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5998ec70-3af0-46d1-b3f2-51ef77e8ea9d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:37.558744 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5998ec70-3af0-46d1-b3f2-51ef77e8ea9d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:37.558960 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-281e09bf-f653-4407-ab5a-1fe495590e60 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:37.559777 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-281e09bf-f653-4407-ab5a-1fe495590e60 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:37.559954 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5998ec70-3af0-46d1-b3f2-51ef77e8ea9d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.233562 Sep 05 12:23:37.566611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-281e09bf-f653-4407-ab5a-1fe495590e60 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:37.567242 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-281e09bf-f653-4407-ab5a-1fe495590e60 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:37.567816 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-281e09bf-f653-4407-ab5a-1fe495590e60 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:37.568665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-281e09bf-f653-4407-ab5a-1fe495590e60 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:37.569723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-281e09bf-f653-4407-ab5a-1fe495590e60 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:37.570290 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-281e09bf-f653-4407-ab5a-1fe495590e60 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:37.575912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 211/420] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:37 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:37.610007 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-319f089d-dbaa-414d-906e-7fc76c82cd3f tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:37.610623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-319f089d-dbaa-414d-906e-7fc76c82cd3f tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:37.617964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-319f089d-dbaa-414d-906e-7fc76c82cd3f tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:37.618459 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-319f089d-dbaa-414d-906e-7fc76c82cd3f tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:37.618931 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-319f089d-dbaa-414d-906e-7fc76c82cd3f tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:37.619674 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-319f089d-dbaa-414d-906e-7fc76c82cd3f tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:37.620131 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-319f089d-dbaa-414d-906e-7fc76c82cd3f tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:37.620677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-319f089d-dbaa-414d-906e-7fc76c82cd3f tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:37.655812 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-319f089d-dbaa-414d-906e-7fc76c82cd3f tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:37.656124 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-319f089d-dbaa-414d-906e-7fc76c82cd3f tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:37.656564 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-319f089d-dbaa-414d-906e-7fc76c82cd3f tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:37.657014 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-319f089d-dbaa-414d-906e-7fc76c82cd3f tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lazy-loading 'fault' on Instance uuid 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:23:37.700764 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-319f089d-dbaa-414d-906e-7fc76c82cd3f tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0854279bf244198ed61ddff0279655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d891c413f984a409b379359a992000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:37.709452 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-319f089d-dbaa-414d-906e-7fc76c82cd3f tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 200 len: 1304 microversion: 2.1 time: 0.103192 Sep 05 12:23:37.710493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 212/421] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:37 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:37.722135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-281e09bf-f653-4407-ab5a-1fe495590e60 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:37.731044 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-281e09bf-f653-4407-ab5a-1fe495590e60 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.176825 Sep 05 12:23:37.731679 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 210/422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:37 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:38.023931 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b7dc279a-e7f0-4a03-a14f-8f8ab862293b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:38.024685 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b7dc279a-e7f0-4a03-a14f-8f8ab862293b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:38.032075 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b7dc279a-e7f0-4a03-a14f-8f8ab862293b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:38.032759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b7dc279a-e7f0-4a03-a14f-8f8ab862293b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:38.033478 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b7dc279a-e7f0-4a03-a14f-8f8ab862293b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:38.034263 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b7dc279a-e7f0-4a03-a14f-8f8ab862293b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:38.034816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b7dc279a-e7f0-4a03-a14f-8f8ab862293b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:38.035329 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b7dc279a-e7f0-4a03-a14f-8f8ab862293b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:38.194158 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b7dc279a-e7f0-4a03-a14f-8f8ab862293b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:38.202433 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b7dc279a-e7f0-4a03-a14f-8f8ab862293b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1515 microversion: 2.1 time: 0.183990 Sep 05 12:23:38.203022 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 213/423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:38 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:38.276919 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-95500e8e-b22e-4fb8-a7d0-6a492b412869 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:38.277622 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-95500e8e-b22e-4fb8-a7d0-6a492b412869 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:38.284479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-95500e8e-b22e-4fb8-a7d0-6a492b412869 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:38.284951 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-95500e8e-b22e-4fb8-a7d0-6a492b412869 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:38.285608 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-95500e8e-b22e-4fb8-a7d0-6a492b412869 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:38.286525 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-95500e8e-b22e-4fb8-a7d0-6a492b412869 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:38.287158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-95500e8e-b22e-4fb8-a7d0-6a492b412869 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:38.287678 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-95500e8e-b22e-4fb8-a7d0-6a492b412869 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:38.587656 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ed07a486-2394-4954-b34d-213da978d169 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:38.588537 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ed07a486-2394-4954-b34d-213da978d169 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:38.594907 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed07a486-2394-4954-b34d-213da978d169 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:38.595828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed07a486-2394-4954-b34d-213da978d169 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:38.596415 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed07a486-2394-4954-b34d-213da978d169 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:38.597234 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed07a486-2394-4954-b34d-213da978d169 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:38.597908 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed07a486-2394-4954-b34d-213da978d169 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:38.598561 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed07a486-2394-4954-b34d-213da978d169 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:38.741523 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-95500e8e-b22e-4fb8-a7d0-6a492b412869 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:38.750297 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-95500e8e-b22e-4fb8-a7d0-6a492b412869 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.477768 Sep 05 12:23:38.751148 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 211/424] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:38 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:38.755994 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-26cd67b3-9833-45c4-819b-ddbbdc40873e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:38.756900 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-26cd67b3-9833-45c4-819b-ddbbdc40873e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] [instance: 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:38.762871 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ed07a486-2394-4954-b34d-213da978d169 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:38.764525 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-26cd67b3-9833-45c4-819b-ddbbdc40873e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:38.765264 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-26cd67b3-9833-45c4-819b-ddbbdc40873e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:38.765707 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=100 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:38.766164 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-26cd67b3-9833-45c4-819b-ddbbdc40873e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:38.767508 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-26cd67b3-9833-45c4-819b-ddbbdc40873e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:38.768008 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-26cd67b3-9833-45c4-819b-ddbbdc40873e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:38.768667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-26cd67b3-9833-45c4-819b-ddbbdc40873e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:38.774797 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ed07a486-2394-4954-b34d-213da978d169 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:38.776935 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ed07a486-2394-4954-b34d-213da978d169 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:38.781463 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ed07a486-2394-4954-b34d-213da978d169 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.198321 Sep 05 12:23:38.782151 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 214/425] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:38 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:23:38.788581 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1f81b050-ff4e-4a00-ad48-03018693d445 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:38.789437 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-1f81b050-ff4e-4a00-ad48-03018693d445 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:38.796020 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1f81b050-ff4e-4a00-ad48-03018693d445 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:38.796599 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1f81b050-ff4e-4a00-ad48-03018693d445 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:38.797183 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1f81b050-ff4e-4a00-ad48-03018693d445 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:38.798028 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1f81b050-ff4e-4a00-ad48-03018693d445 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:38.798564 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1f81b050-ff4e-4a00-ad48-03018693d445 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:38.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1f81b050-ff4e-4a00-ad48-03018693d445 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:38.801523 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-26cd67b3-9833-45c4-819b-ddbbdc40873e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] HTTP exception thrown: Instance 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c could not be found. Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-26cd67b3-9833-45c4-819b-ddbbdc40873e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Request method failure captured: Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c HTTP/1.1 Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFeobCA78qqHhAF0hrdJQFO1fPZZAbyir-U1dFBZqtPHom4MbfML390yJko_nM9yQuPB8Uzk4dV56KOcHKFnsedezf0vlR7wsRCn-dVWjbSN9a4fJ2euJAChpJ61YUDrVfWHFvYVtot-MsSbaefwkyjluZpmigXKbrhPLlSNtd5rKdfw Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 5d891c413f984a409b379359a992000a Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-VolumesNegativeTest-1117883739 Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:23:38.807767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:23:38.809501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d891c413f984a409b379359a992000a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d891c413f984a409b379359a992000a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d891c413f984a409b379359a992000a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d891c413f984a409b379359a992000a"}]}] Sep 05 12:23:38.809501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-VolumesNegativeTest-1117883739 Sep 05 12:23:38.809501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 5d891c413f984a409b379359a992000a Sep 05 12:23:38.809501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-VolumesNegativeTest-1117883739 Sep 05 12:23:38.809501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-VolumesNegativeTest-1117883739-project Sep 05 12:23:38.809501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:23:38.809501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:23:38.809501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: ab0854279bf244198ed61ddff0279655 Sep 05 12:23:38.809501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-VolumesNegativeTest-1117883739-project Sep 05 12:23:38.809501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:23:38.809501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c could not be found. Sep 05 12:23:38.809501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '5c7311ba-3cf9-456b-a954-a3c8bdda4b6c'} Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c could not be found. Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:23:38.810415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c could not be found. Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c could not be found. Sep 05 12:23:38.812672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:23:38.814033 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-26cd67b3-9833-45c4-819b-ddbbdc40873e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] Returning 404 to user: Instance 5c7311ba-3cf9-456b-a954-a3c8bdda4b6c could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:23:38.814033 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-26cd67b3-9833-45c4-819b-ddbbdc40873e tempest-VolumesNegativeTest-1117883739 tempest-VolumesNegativeTest-1117883739-project] 10.222.0.16 "GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c" status: 404 len: 111 microversion: 2.1 time: 0.058288 Sep 05 12:23:38.814033 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 212/426] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:38 2022] GET /compute/v2.1/servers/5c7311ba-3cf9-456b-a954-a3c8bdda4b6c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:23:38.950384 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1f81b050-ff4e-4a00-ad48-03018693d445 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:38.963065 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1f81b050-ff4e-4a00-ad48-03018693d445 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.178622 Sep 05 12:23:38.964220 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 215/427] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:38 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:39.061848 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-abf47206-a1d5-4f1a-9e98-16a982e27ad6 req-c2a8672d-e8ff-4edb-8027-31c131cbaa08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28f7109c-1b2e-4b1b-9a90-226fe01d3cdd", "name": "network-vif-deleted", "tag": "c5a7515d-ef12-4857-a4a9-d06646b977da"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:39.072565 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-abf47206-a1d5-4f1a-9e98-16a982e27ad6 req-c2a8672d-e8ff-4edb-8027-31c131cbaa08 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:39.073206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-abf47206-a1d5-4f1a-9e98-16a982e27ad6 req-c2a8672d-e8ff-4edb-8027-31c131cbaa08 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:39.073667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-abf47206-a1d5-4f1a-9e98-16a982e27ad6 req-c2a8672d-e8ff-4edb-8027-31c131cbaa08 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:39.088615 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-abf47206-a1d5-4f1a-9e98-16a982e27ad6 req-c2a8672d-e8ff-4edb-8027-31c131cbaa08 service nova] Creating event network-vif-deleted:c5a7515d-ef12-4857-a4a9-d06646b977da for instance 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd on hv-cinder-85518 Sep 05 12:23:39.094484 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-abf47206-a1d5-4f1a-9e98-16a982e27ad6 req-c2a8672d-e8ff-4edb-8027-31c131cbaa08 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036186 Sep 05 12:23:39.095629 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 213/428] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:23:39.227228 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-92ff6861-b97e-458c-aa7c-23aea8fd5dcd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:39.227915 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-92ff6861-b97e-458c-aa7c-23aea8fd5dcd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:39.234727 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92ff6861-b97e-458c-aa7c-23aea8fd5dcd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:39.235554 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92ff6861-b97e-458c-aa7c-23aea8fd5dcd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:39.236170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92ff6861-b97e-458c-aa7c-23aea8fd5dcd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:39.237071 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92ff6861-b97e-458c-aa7c-23aea8fd5dcd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:39.237533 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92ff6861-b97e-458c-aa7c-23aea8fd5dcd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:39.237963 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92ff6861-b97e-458c-aa7c-23aea8fd5dcd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:39.274396 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92ff6861-b97e-458c-aa7c-23aea8fd5dcd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:39.274876 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92ff6861-b97e-458c-aa7c-23aea8fd5dcd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:39.275309 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92ff6861-b97e-458c-aa7c-23aea8fd5dcd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:39.276244 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-92ff6861-b97e-458c-aa7c-23aea8fd5dcd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lazy-loading 'fault' on Instance uuid 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:23:39.328390 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-92ff6861-b97e-458c-aa7c-23aea8fd5dcd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:39.337610 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-92ff6861-b97e-458c-aa7c-23aea8fd5dcd tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1309 microversion: 2.1 time: 0.114615 Sep 05 12:23:39.349299 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 216/429] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:39 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:39.775144 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0c0bf892-4f91-4870-9f4b-6909616ddd14 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:39.776141 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0c0bf892-4f91-4870-9f4b-6909616ddd14 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:39.783145 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0c0bf892-4f91-4870-9f4b-6909616ddd14 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:39.783487 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0c0bf892-4f91-4870-9f4b-6909616ddd14 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:39.783952 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0c0bf892-4f91-4870-9f4b-6909616ddd14 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:39.784653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0c0bf892-4f91-4870-9f4b-6909616ddd14 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:39.785133 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0c0bf892-4f91-4870-9f4b-6909616ddd14 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:39.785544 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0c0bf892-4f91-4870-9f4b-6909616ddd14 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:39.813751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e418bc23-e9fb-48f2-b221-76191bb09294 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:39.815141 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e418bc23-e9fb-48f2-b221-76191bb09294 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:39.821824 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e418bc23-e9fb-48f2-b221-76191bb09294 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:39.822312 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e418bc23-e9fb-48f2-b221-76191bb09294 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:39.822801 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e418bc23-e9fb-48f2-b221-76191bb09294 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:39.823776 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e418bc23-e9fb-48f2-b221-76191bb09294 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:39.824011 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e418bc23-e9fb-48f2-b221-76191bb09294 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:39.824437 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e418bc23-e9fb-48f2-b221-76191bb09294 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:39.945748 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0c0bf892-4f91-4870-9f4b-6909616ddd14 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:39.954195 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0c0bf892-4f91-4870-9f4b-6909616ddd14 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.183661 Sep 05 12:23:39.954776 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 214/430] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:39 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:39.972064 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e418bc23-e9fb-48f2-b221-76191bb09294 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:39.981178 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e418bc23-e9fb-48f2-b221-76191bb09294 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:39.982760 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e418bc23-e9fb-48f2-b221-76191bb09294 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:39.984038 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e418bc23-e9fb-48f2-b221-76191bb09294 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.174246 Sep 05 12:23:39.984916 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 217/431] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:39 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:23:39.988699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2de0e899-2504-488e-a484-eec7df46d829 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:39.989320 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2de0e899-2504-488e-a484-eec7df46d829 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:39.995400 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2de0e899-2504-488e-a484-eec7df46d829 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:39.995952 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2de0e899-2504-488e-a484-eec7df46d829 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:39.996641 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2de0e899-2504-488e-a484-eec7df46d829 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:39.997383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2de0e899-2504-488e-a484-eec7df46d829 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:39.997846 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2de0e899-2504-488e-a484-eec7df46d829 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:39.998308 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2de0e899-2504-488e-a484-eec7df46d829 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:40.134308 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2de0e899-2504-488e-a484-eec7df46d829 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:40.142616 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2de0e899-2504-488e-a484-eec7df46d829 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.158275 Sep 05 12:23:40.143173 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 215/432] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:39 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:40.365739 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-570c5b96-ae72-4244-b9b7-9e79519d150b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:40.366395 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-570c5b96-ae72-4244-b9b7-9e79519d150b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:40.375428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-570c5b96-ae72-4244-b9b7-9e79519d150b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:40.375961 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-570c5b96-ae72-4244-b9b7-9e79519d150b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:40.376401 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-570c5b96-ae72-4244-b9b7-9e79519d150b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:40.377107 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-570c5b96-ae72-4244-b9b7-9e79519d150b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:40.377562 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-570c5b96-ae72-4244-b9b7-9e79519d150b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:40.377992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-570c5b96-ae72-4244-b9b7-9e79519d150b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:40.413217 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-570c5b96-ae72-4244-b9b7-9e79519d150b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:40.413731 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-570c5b96-ae72-4244-b9b7-9e79519d150b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:40.414114 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-570c5b96-ae72-4244-b9b7-9e79519d150b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:40.414561 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-570c5b96-ae72-4244-b9b7-9e79519d150b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lazy-loading 'fault' on Instance uuid 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:23:40.463355 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-570c5b96-ae72-4244-b9b7-9e79519d150b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:40.471265 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-570c5b96-ae72-4244-b9b7-9e79519d150b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 200 len: 1309 microversion: 2.1 time: 0.109977 Sep 05 12:23:40.471900 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 218/433] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:40 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:40.982124 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1f63cff7-91ad-4cf9-aecc-7e39fcfc644d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:40.983150 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1f63cff7-91ad-4cf9-aecc-7e39fcfc644d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:40.991466 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f63cff7-91ad-4cf9-aecc-7e39fcfc644d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:40.992520 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f63cff7-91ad-4cf9-aecc-7e39fcfc644d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:40.993070 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f63cff7-91ad-4cf9-aecc-7e39fcfc644d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:40.994464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f63cff7-91ad-4cf9-aecc-7e39fcfc644d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:40.995052 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f63cff7-91ad-4cf9-aecc-7e39fcfc644d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:40.995744 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f63cff7-91ad-4cf9-aecc-7e39fcfc644d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:41.010749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1fcf9f83-133c-470c-a8bc-ce88afb9c832 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:41.011692 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-1fcf9f83-133c-470c-a8bc-ce88afb9c832 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:41.019339 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1fcf9f83-133c-470c-a8bc-ce88afb9c832 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:41.019868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1fcf9f83-133c-470c-a8bc-ce88afb9c832 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:41.020307 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1fcf9f83-133c-470c-a8bc-ce88afb9c832 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:41.021009 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1fcf9f83-133c-470c-a8bc-ce88afb9c832 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:41.021467 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1fcf9f83-133c-470c-a8bc-ce88afb9c832 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:41.021895 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1fcf9f83-133c-470c-a8bc-ce88afb9c832 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:41.143869 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1f63cff7-91ad-4cf9-aecc-7e39fcfc644d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:41.155396 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1f63cff7-91ad-4cf9-aecc-7e39fcfc644d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.177689 Sep 05 12:23:41.159564 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 216/434] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:40 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:41.174420 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1fcf9f83-133c-470c-a8bc-ce88afb9c832 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:41.176831 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4b11003d-8176-4f29-8952-f876fa9bb9a3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:41.177677 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4b11003d-8176-4f29-8952-f876fa9bb9a3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:41.184248 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1fcf9f83-133c-470c-a8bc-ce88afb9c832 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:41.184565 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4b11003d-8176-4f29-8952-f876fa9bb9a3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:41.185050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4b11003d-8176-4f29-8952-f876fa9bb9a3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:41.185482 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4b11003d-8176-4f29-8952-f876fa9bb9a3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:41.186190 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1fcf9f83-133c-470c-a8bc-ce88afb9c832 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:41.186465 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4b11003d-8176-4f29-8952-f876fa9bb9a3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:41.186983 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4b11003d-8176-4f29-8952-f876fa9bb9a3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:41.187457 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1fcf9f83-133c-470c-a8bc-ce88afb9c832 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.181235 Sep 05 12:23:41.187582 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4b11003d-8176-4f29-8952-f876fa9bb9a3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:41.188083 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 219/435] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:41 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:23:41.339173 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4b11003d-8176-4f29-8952-f876fa9bb9a3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:41.347603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4b11003d-8176-4f29-8952-f876fa9bb9a3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.181158 Sep 05 12:23:41.348101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 217/436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:41 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:41.494391 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0f4391e4-b4e2-49ab-820c-587744df3410 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:41.495004 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0f4391e4-b4e2-49ab-820c-587744df3410 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:41.501470 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0f4391e4-b4e2-49ab-820c-587744df3410 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:41.501958 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0f4391e4-b4e2-49ab-820c-587744df3410 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:41.502392 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0f4391e4-b4e2-49ab-820c-587744df3410 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:41.503095 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0f4391e4-b4e2-49ab-820c-587744df3410 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:41.503566 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0f4391e4-b4e2-49ab-820c-587744df3410 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:41.503994 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0f4391e4-b4e2-49ab-820c-587744df3410 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:41.517700 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-0f4391e4-b4e2-49ab-820c-587744df3410 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] HTTP exception thrown: Instance 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd could not be found. Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0f4391e4-b4e2-49ab-820c-587744df3410 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Request method failure captured: Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd HTTP/1.1 Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFenayNbRU0Qo_do2q4yR4-oZo0XogZ6CLJLkRArzwKYS2mgTAcp8W2dnqNH0NY7sDhV01cynvYS3INHPOFXysl3Q0d-W4JAkjXN7FY85o7GueX4Wuici0SoyvRRb5M1-VZuQPh44OSkDIRNF8YnK_udK1PE_md44mPdNJ8g0oVlBrzU Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 57a93fc888a145c88b28b8b73060731e Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1094691745 Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:23:41.519341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:23:41.520944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57a93fc888a145c88b28b8b73060731e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57a93fc888a145c88b28b8b73060731e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57a93fc888a145c88b28b8b73060731e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57a93fc888a145c88b28b8b73060731e"}]}] Sep 05 12:23:41.520944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-VolumesSnapshotTestJSON-1094691745 Sep 05 12:23:41.520944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 57a93fc888a145c88b28b8b73060731e Sep 05 12:23:41.520944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1094691745 Sep 05 12:23:41.520944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-VolumesSnapshotTestJSON-1094691745-project Sep 05 12:23:41.520944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:23:41.520944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:23:41.520944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: 4e187162f3e64acdb8cd24f660ceeca6 Sep 05 12:23:41.520944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-VolumesSnapshotTestJSON-1094691745-project Sep 05 12:23:41.520944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:23:41.520944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd could not be found. Sep 05 12:23:41.520944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '28f7109c-1b2e-4b1b-9a90-226fe01d3cdd'} Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd could not be found. Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:23:41.521893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd could not be found. Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd could not be found. Sep 05 12:23:41.523992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:23:41.526106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0f4391e4-b4e2-49ab-820c-587744df3410 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Returning 404 to user: Instance 28f7109c-1b2e-4b1b-9a90-226fe01d3cdd could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:23:41.526106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0f4391e4-b4e2-49ab-820c-587744df3410 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd" status: 404 len: 111 microversion: 2.1 time: 0.030203 Sep 05 12:23:41.526106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 220/437] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:41 2022] GET /compute/v2.1/servers/28f7109c-1b2e-4b1b-9a90-226fe01d3cdd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:23:42.181761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9c330c3e-aecc-4197-98d1-d3c0f8fd1556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:42.182431 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9c330c3e-aecc-4197-98d1-d3c0f8fd1556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:42.189088 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9c330c3e-aecc-4197-98d1-d3c0f8fd1556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:42.189590 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9c330c3e-aecc-4197-98d1-d3c0f8fd1556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:42.190024 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9c330c3e-aecc-4197-98d1-d3c0f8fd1556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:42.190736 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9c330c3e-aecc-4197-98d1-d3c0f8fd1556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:42.191197 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9c330c3e-aecc-4197-98d1-d3c0f8fd1556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:42.191667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9c330c3e-aecc-4197-98d1-d3c0f8fd1556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:42.213656 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-343b7a0a-5650-455f-af12-86877fadbdc6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:42.214798 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-343b7a0a-5650-455f-af12-86877fadbdc6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:42.221693 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-343b7a0a-5650-455f-af12-86877fadbdc6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:42.222299 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-343b7a0a-5650-455f-af12-86877fadbdc6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:42.222828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-343b7a0a-5650-455f-af12-86877fadbdc6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:42.223694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-343b7a0a-5650-455f-af12-86877fadbdc6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:42.224254 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-343b7a0a-5650-455f-af12-86877fadbdc6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:42.224773 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-343b7a0a-5650-455f-af12-86877fadbdc6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:42.348520 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9c330c3e-aecc-4197-98d1-d3c0f8fd1556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:42.358231 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9c330c3e-aecc-4197-98d1-d3c0f8fd1556 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.181788 Sep 05 12:23:42.359032 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 218/438] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:42 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:42.371764 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5f69f8f4-8b2f-442e-a791-03369ceba3bd tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:42.372893 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5f69f8f4-8b2f-442e-a791-03369ceba3bd tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:42.380400 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f69f8f4-8b2f-442e-a791-03369ceba3bd tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:42.381318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f69f8f4-8b2f-442e-a791-03369ceba3bd tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:42.382483 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f69f8f4-8b2f-442e-a791-03369ceba3bd tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:42.382900 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-343b7a0a-5650-455f-af12-86877fadbdc6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:42.384397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f69f8f4-8b2f-442e-a791-03369ceba3bd tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:42.384922 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f69f8f4-8b2f-442e-a791-03369ceba3bd tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:42.385575 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f69f8f4-8b2f-442e-a791-03369ceba3bd tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:42.391637 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-343b7a0a-5650-455f-af12-86877fadbdc6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:42.393066 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-343b7a0a-5650-455f-af12-86877fadbdc6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:42.394239 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-343b7a0a-5650-455f-af12-86877fadbdc6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.185153 Sep 05 12:23:42.394771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 221/439] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:42 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:23:42.526105 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5f69f8f4-8b2f-442e-a791-03369ceba3bd tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:42.534239 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5f69f8f4-8b2f-442e-a791-03369ceba3bd tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.166301 Sep 05 12:23:42.534805 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 219/440] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:42 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:43.382886 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4f4e316d-948c-452d-a0f1-5a6d871cd25c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:43.383639 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4f4e316d-948c-452d-a0f1-5a6d871cd25c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:43.390622 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f4e316d-948c-452d-a0f1-5a6d871cd25c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:43.391112 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f4e316d-948c-452d-a0f1-5a6d871cd25c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:43.391574 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f4e316d-948c-452d-a0f1-5a6d871cd25c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:43.392285 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f4e316d-948c-452d-a0f1-5a6d871cd25c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:43.392742 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f4e316d-948c-452d-a0f1-5a6d871cd25c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:43.393163 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f4e316d-948c-452d-a0f1-5a6d871cd25c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:43.419549 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2e4cbe0a-bfc0-4f7c-b1be-8fc7a9e6cfac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:43.420168 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2e4cbe0a-bfc0-4f7c-b1be-8fc7a9e6cfac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:43.426784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2e4cbe0a-bfc0-4f7c-b1be-8fc7a9e6cfac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:43.427269 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2e4cbe0a-bfc0-4f7c-b1be-8fc7a9e6cfac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:43.427732 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2e4cbe0a-bfc0-4f7c-b1be-8fc7a9e6cfac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:43.428482 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2e4cbe0a-bfc0-4f7c-b1be-8fc7a9e6cfac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:43.428942 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2e4cbe0a-bfc0-4f7c-b1be-8fc7a9e6cfac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:43.429371 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2e4cbe0a-bfc0-4f7c-b1be-8fc7a9e6cfac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:43.571930 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2e4cbe0a-bfc0-4f7c-b1be-8fc7a9e6cfac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:43.580454 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2e4cbe0a-bfc0-4f7c-b1be-8fc7a9e6cfac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:43.581897 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2e4cbe0a-bfc0-4f7c-b1be-8fc7a9e6cfac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:43.583049 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2e4cbe0a-bfc0-4f7c-b1be-8fc7a9e6cfac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.167428 Sep 05 12:23:43.583631 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 220/441] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:43 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:23:43.588721 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-52bfde4f-8624-4871-868a-7b7ff7749827 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:43.589327 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-52bfde4f-8624-4871-868a-7b7ff7749827 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:43.596168 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52bfde4f-8624-4871-868a-7b7ff7749827 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:43.596658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52bfde4f-8624-4871-868a-7b7ff7749827 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:43.597091 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52bfde4f-8624-4871-868a-7b7ff7749827 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:43.597988 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52bfde4f-8624-4871-868a-7b7ff7749827 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:43.598454 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52bfde4f-8624-4871-868a-7b7ff7749827 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:43.598876 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52bfde4f-8624-4871-868a-7b7ff7749827 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:43.603437 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:43.714790 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4f4e316d-948c-452d-a0f1-5a6d871cd25c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:43.722762 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4f4e316d-948c-452d-a0f1-5a6d871cd25c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.344706 Sep 05 12:23:43.723338 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 222/442] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:43 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:43.742070 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-52bfde4f-8624-4871-868a-7b7ff7749827 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:43.750423 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-52bfde4f-8624-4871-868a-7b7ff7749827 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.165805 Sep 05 12:23:43.751000 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 221/443] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:43 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:44.609921 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-21ee99e4-d060-481c-8a0d-d90a3e5c971c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:44.610672 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-21ee99e4-d060-481c-8a0d-d90a3e5c971c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:44.617403 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21ee99e4-d060-481c-8a0d-d90a3e5c971c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:44.617878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21ee99e4-d060-481c-8a0d-d90a3e5c971c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:44.618307 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21ee99e4-d060-481c-8a0d-d90a3e5c971c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:44.618996 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21ee99e4-d060-481c-8a0d-d90a3e5c971c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:44.619445 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21ee99e4-d060-481c-8a0d-d90a3e5c971c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:44.619891 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21ee99e4-d060-481c-8a0d-d90a3e5c971c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:44.746488 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-92cf5606-3c1d-42ad-b882-0abaf50a37eb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:44.747247 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-92cf5606-3c1d-42ad-b882-0abaf50a37eb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:44.753931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-92cf5606-3c1d-42ad-b882-0abaf50a37eb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:44.754508 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-92cf5606-3c1d-42ad-b882-0abaf50a37eb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:44.755013 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-92cf5606-3c1d-42ad-b882-0abaf50a37eb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:44.755752 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-92cf5606-3c1d-42ad-b882-0abaf50a37eb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:44.756201 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-92cf5606-3c1d-42ad-b882-0abaf50a37eb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:44.757264 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-92cf5606-3c1d-42ad-b882-0abaf50a37eb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:44.760792 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-21ee99e4-d060-481c-8a0d-d90a3e5c971c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:44.770174 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-21ee99e4-d060-481c-8a0d-d90a3e5c971c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:44.771865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-21ee99e4-d060-481c-8a0d-d90a3e5c971c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:44.772971 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-21ee99e4-d060-481c-8a0d-d90a3e5c971c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.167139 Sep 05 12:23:44.778114 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 223/444] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:44 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:44.778456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-abd5d9b4-6269-4f73-9226-db917389ba39 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:44.779231 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-abd5d9b4-6269-4f73-9226-db917389ba39 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:44.785507 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-abd5d9b4-6269-4f73-9226-db917389ba39 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:44.785978 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-abd5d9b4-6269-4f73-9226-db917389ba39 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:44.786627 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-abd5d9b4-6269-4f73-9226-db917389ba39 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:44.787337 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-abd5d9b4-6269-4f73-9226-db917389ba39 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:44.787828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-abd5d9b4-6269-4f73-9226-db917389ba39 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:44.788260 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-abd5d9b4-6269-4f73-9226-db917389ba39 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:44.922399 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-92cf5606-3c1d-42ad-b882-0abaf50a37eb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:44.930973 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-92cf5606-3c1d-42ad-b882-0abaf50a37eb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.188775 Sep 05 12:23:44.931569 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 222/445] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:44 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:44.948514 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-abd5d9b4-6269-4f73-9226-db917389ba39 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:44.956863 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-abd5d9b4-6269-4f73-9226-db917389ba39 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.182517 Sep 05 12:23:44.957435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 224/446] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:44 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:45.798898 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5cf89453-3663-4f90-bf50-6114c9705a30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:45.799585 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5cf89453-3663-4f90-bf50-6114c9705a30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:45.806450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5cf89453-3663-4f90-bf50-6114c9705a30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:45.806931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5cf89453-3663-4f90-bf50-6114c9705a30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:45.807373 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5cf89453-3663-4f90-bf50-6114c9705a30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:45.808108 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5cf89453-3663-4f90-bf50-6114c9705a30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:45.808565 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5cf89453-3663-4f90-bf50-6114c9705a30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:45.808997 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5cf89453-3663-4f90-bf50-6114c9705a30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:45.944135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5cf89453-3663-4f90-bf50-6114c9705a30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:45.953553 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5cf89453-3663-4f90-bf50-6114c9705a30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:45.954267 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-42304c35-dbec-47d3-ac88-ff5e2eb3362f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:45.955021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5cf89453-3663-4f90-bf50-6114c9705a30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:45.955380 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-42304c35-dbec-47d3-ac88-ff5e2eb3362f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:45.956215 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5cf89453-3663-4f90-bf50-6114c9705a30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.161316 Sep 05 12:23:45.956769 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 223/447] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:45 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:45.962051 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-42304c35-dbec-47d3-ac88-ff5e2eb3362f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:45.962540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-42304c35-dbec-47d3-ac88-ff5e2eb3362f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:45.962970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-42304c35-dbec-47d3-ac88-ff5e2eb3362f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:45.963702 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-42304c35-dbec-47d3-ac88-ff5e2eb3362f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:45.964953 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-42304c35-dbec-47d3-ac88-ff5e2eb3362f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:45.964953 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-42304c35-dbec-47d3-ac88-ff5e2eb3362f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:45.979872 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3d29ed3e-5b53-473c-b0bc-3fbd6eed9b8a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:45.980483 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-3d29ed3e-5b53-473c-b0bc-3fbd6eed9b8a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:45.987607 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3d29ed3e-5b53-473c-b0bc-3fbd6eed9b8a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:45.988274 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3d29ed3e-5b53-473c-b0bc-3fbd6eed9b8a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:45.988713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3d29ed3e-5b53-473c-b0bc-3fbd6eed9b8a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:45.989420 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3d29ed3e-5b53-473c-b0bc-3fbd6eed9b8a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:45.989876 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3d29ed3e-5b53-473c-b0bc-3fbd6eed9b8a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:45.990304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3d29ed3e-5b53-473c-b0bc-3fbd6eed9b8a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:46.111963 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-42304c35-dbec-47d3-ac88-ff5e2eb3362f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:46.123442 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-42304c35-dbec-47d3-ac88-ff5e2eb3362f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.172887 Sep 05 12:23:46.124385 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 225/448] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:45 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:46.144019 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-3d29ed3e-5b53-473c-b0bc-3fbd6eed9b8a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:46.153448 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-3d29ed3e-5b53-473c-b0bc-3fbd6eed9b8a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.177405 Sep 05 12:23:46.154087 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 224/449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:45 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:46.983054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f75598c4-e2a9-4413-9f84-2ae7586151c3 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:46.983704 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f75598c4-e2a9-4413-9f84-2ae7586151c3 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:46.990140 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f75598c4-e2a9-4413-9f84-2ae7586151c3 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:46.990621 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f75598c4-e2a9-4413-9f84-2ae7586151c3 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:46.991163 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f75598c4-e2a9-4413-9f84-2ae7586151c3 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:46.992006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f75598c4-e2a9-4413-9f84-2ae7586151c3 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:46.992561 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f75598c4-e2a9-4413-9f84-2ae7586151c3 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:46.993064 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f75598c4-e2a9-4413-9f84-2ae7586151c3 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:47.134759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f75598c4-e2a9-4413-9f84-2ae7586151c3 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:47.142952 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f75598c4-e2a9-4413-9f84-2ae7586151c3 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:47.144437 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f75598c4-e2a9-4413-9f84-2ae7586151c3 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:47.145594 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f75598c4-e2a9-4413-9f84-2ae7586151c3 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.167047 Sep 05 12:23:47.146211 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 226/450] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:46 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:47.152845 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c2cd1ca3-aca4-46f8-9185-6e411d62bc7c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:47.153536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c2cd1ca3-aca4-46f8-9185-6e411d62bc7c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:47.160620 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c2cd1ca3-aca4-46f8-9185-6e411d62bc7c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:47.161179 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c2cd1ca3-aca4-46f8-9185-6e411d62bc7c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:47.161682 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c2cd1ca3-aca4-46f8-9185-6e411d62bc7c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:47.162442 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c2cd1ca3-aca4-46f8-9185-6e411d62bc7c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:47.162971 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c2cd1ca3-aca4-46f8-9185-6e411d62bc7c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:47.163466 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c2cd1ca3-aca4-46f8-9185-6e411d62bc7c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:47.181324 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4c6776da-2333-4fd6-86d5-4c2a96a14a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:47.182177 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4c6776da-2333-4fd6-86d5-4c2a96a14a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:47.188280 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c6776da-2333-4fd6-86d5-4c2a96a14a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:47.188771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c6776da-2333-4fd6-86d5-4c2a96a14a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:47.189211 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c6776da-2333-4fd6-86d5-4c2a96a14a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:47.189914 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c6776da-2333-4fd6-86d5-4c2a96a14a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:47.190369 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c6776da-2333-4fd6-86d5-4c2a96a14a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:47.191018 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c6776da-2333-4fd6-86d5-4c2a96a14a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:47.316358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c2cd1ca3-aca4-46f8-9185-6e411d62bc7c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:47.325161 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c2cd1ca3-aca4-46f8-9185-6e411d62bc7c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.176260 Sep 05 12:23:47.326238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 225/451] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:47 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:47.332110 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4c6776da-2333-4fd6-86d5-4c2a96a14a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:47.341319 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4c6776da-2333-4fd6-86d5-4c2a96a14a03 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.168478 Sep 05 12:23:47.342270 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 227/452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:47 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:48.173684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c9fb66f8-f8f5-4c12-b281-9c83ca9306fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:48.174397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c9fb66f8-f8f5-4c12-b281-9c83ca9306fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:48.182165 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c9fb66f8-f8f5-4c12-b281-9c83ca9306fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:48.182654 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c9fb66f8-f8f5-4c12-b281-9c83ca9306fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:48.183083 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c9fb66f8-f8f5-4c12-b281-9c83ca9306fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:48.183819 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c9fb66f8-f8f5-4c12-b281-9c83ca9306fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:48.184271 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c9fb66f8-f8f5-4c12-b281-9c83ca9306fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:48.184877 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c9fb66f8-f8f5-4c12-b281-9c83ca9306fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:48.349202 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d8650ce4-d5e2-4346-93ab-cb485c094fe8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:48.350033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d8650ce4-d5e2-4346-93ab-cb485c094fe8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:48.357782 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d8650ce4-d5e2-4346-93ab-cb485c094fe8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:48.358174 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d8650ce4-d5e2-4346-93ab-cb485c094fe8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:48.358797 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d8650ce4-d5e2-4346-93ab-cb485c094fe8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:48.359568 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d8650ce4-d5e2-4346-93ab-cb485c094fe8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:48.362165 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d8650ce4-d5e2-4346-93ab-cb485c094fe8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:48.362623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d8650ce4-d5e2-4346-93ab-cb485c094fe8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:48.503940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d8650ce4-d5e2-4346-93ab-cb485c094fe8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:48.511807 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d8650ce4-d5e2-4346-93ab-cb485c094fe8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.166857 Sep 05 12:23:48.512389 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 228/453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:48 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:48.516344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c9fb66f8-f8f5-4c12-b281-9c83ca9306fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:48.517287 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-68723a9a-19b3-427f-828d-7ed2409ce7a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:48.518105 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-68723a9a-19b3-427f-828d-7ed2409ce7a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:48.524457 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68723a9a-19b3-427f-828d-7ed2409ce7a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:48.525250 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68723a9a-19b3-427f-828d-7ed2409ce7a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:48.525934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68723a9a-19b3-427f-828d-7ed2409ce7a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:48.526048 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c9fb66f8-f8f5-4c12-b281-9c83ca9306fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:48.526628 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68723a9a-19b3-427f-828d-7ed2409ce7a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:48.527084 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68723a9a-19b3-427f-828d-7ed2409ce7a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:48.527510 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68723a9a-19b3-427f-828d-7ed2409ce7a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:48.527753 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c9fb66f8-f8f5-4c12-b281-9c83ca9306fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:48.528920 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c9fb66f8-f8f5-4c12-b281-9c83ca9306fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1744 microversion: 2.20 time: 0.359146 Sep 05 12:23:48.529513 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 226/454] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:48 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1744 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:48.659146 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-68723a9a-19b3-427f-828d-7ed2409ce7a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:48.667592 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-68723a9a-19b3-427f-828d-7ed2409ce7a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.154187 Sep 05 12:23:48.668161 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 229/455] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:48 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:49.315622 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-e42af210-b79e-48b9-881d-81e54a9c1669 req-a6b5e440-34ff-4ff1-bb71-8cb0e072d593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4181d872-fbd4-4b16-b8c2-d086dd1253b2", "name": "network-vif-plugged", "status": "completed", "tag": "935d1954-274e-487a-b68a-696df548ac2a"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:49.327408 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-e42af210-b79e-48b9-881d-81e54a9c1669 req-a6b5e440-34ff-4ff1-bb71-8cb0e072d593 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:49.327898 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-e42af210-b79e-48b9-881d-81e54a9c1669 req-a6b5e440-34ff-4ff1-bb71-8cb0e072d593 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:49.328350 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-e42af210-b79e-48b9-881d-81e54a9c1669 req-a6b5e440-34ff-4ff1-bb71-8cb0e072d593 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:49.339559 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-e42af210-b79e-48b9-881d-81e54a9c1669 req-a6b5e440-34ff-4ff1-bb71-8cb0e072d593 service nova] Creating event network-vif-plugged:935d1954-274e-487a-b68a-696df548ac2a for instance 4181d872-fbd4-4b16-b8c2-d086dd1253b2 on hv-cinder-85518 Sep 05 12:23:49.344611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-e42af210-b79e-48b9-881d-81e54a9c1669 req-a6b5e440-34ff-4ff1-bb71-8cb0e072d593 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032716 Sep 05 12:23:49.345189 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 227/456] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:23:49.534185 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c3ba6bd9-2a44-4933-bcd2-1e4accf544a8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:49.534800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c3ba6bd9-2a44-4933-bcd2-1e4accf544a8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:49.541814 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c3ba6bd9-2a44-4933-bcd2-1e4accf544a8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:49.542314 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c3ba6bd9-2a44-4933-bcd2-1e4accf544a8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:49.542734 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c3ba6bd9-2a44-4933-bcd2-1e4accf544a8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:49.543418 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c3ba6bd9-2a44-4933-bcd2-1e4accf544a8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:49.543926 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c3ba6bd9-2a44-4933-bcd2-1e4accf544a8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:49.544349 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c3ba6bd9-2a44-4933-bcd2-1e4accf544a8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:49.555824 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-51958ff3-2299-46a9-8183-5d39f72ba672 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:49.556583 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-51958ff3-2299-46a9-8183-5d39f72ba672 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:49.562825 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51958ff3-2299-46a9-8183-5d39f72ba672 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:49.563300 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51958ff3-2299-46a9-8183-5d39f72ba672 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:49.563757 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51958ff3-2299-46a9-8183-5d39f72ba672 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:49.564443 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51958ff3-2299-46a9-8183-5d39f72ba672 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:49.564891 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51958ff3-2299-46a9-8183-5d39f72ba672 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:49.565317 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51958ff3-2299-46a9-8183-5d39f72ba672 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:49.676405 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c3ba6bd9-2a44-4933-bcd2-1e4accf544a8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:49.686858 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c3ba6bd9-2a44-4933-bcd2-1e4accf544a8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.156403 Sep 05 12:23:49.687355 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 230/457] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:49 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:49.691796 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-aa305908-695f-42e3-9279-905c134c5cb1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:49.692392 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-aa305908-695f-42e3-9279-905c134c5cb1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:49.699683 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-51958ff3-2299-46a9-8183-5d39f72ba672 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:49.704234 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa305908-695f-42e3-9279-905c134c5cb1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:49.704714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa305908-695f-42e3-9279-905c134c5cb1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:49.705142 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa305908-695f-42e3-9279-905c134c5cb1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:49.705829 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa305908-695f-42e3-9279-905c134c5cb1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:49.706278 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa305908-695f-42e3-9279-905c134c5cb1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:49.706692 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa305908-695f-42e3-9279-905c134c5cb1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:49.707891 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-51958ff3-2299-46a9-8183-5d39f72ba672 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:49.709345 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-51958ff3-2299-46a9-8183-5d39f72ba672 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:49.711048 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-51958ff3-2299-46a9-8183-5d39f72ba672 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1744 microversion: 2.20 time: 0.160235 Sep 05 12:23:49.711632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 228/458] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:49 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:23:49.722425 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=100 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:49.839833 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-aa305908-695f-42e3-9279-905c134c5cb1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:49.848065 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-aa305908-695f-42e3-9279-905c134c5cb1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.159745 Sep 05 12:23:49.848626 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 231/459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:49 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:50.710199 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-81e828f1-4b73-4ac6-8746-63a10020c1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:50.710726 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-81e828f1-4b73-4ac6-8746-63a10020c1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:50.717276 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-81e828f1-4b73-4ac6-8746-63a10020c1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:50.717758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-81e828f1-4b73-4ac6-8746-63a10020c1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:50.718197 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-81e828f1-4b73-4ac6-8746-63a10020c1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:50.718892 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-81e828f1-4b73-4ac6-8746-63a10020c1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:50.719357 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-81e828f1-4b73-4ac6-8746-63a10020c1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:50.719811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-81e828f1-4b73-4ac6-8746-63a10020c1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:50.736543 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-55b3a29c-1f30-4eb0-83f7-9403590c897b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:50.737148 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-55b3a29c-1f30-4eb0-83f7-9403590c897b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:50.744294 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-55b3a29c-1f30-4eb0-83f7-9403590c897b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:50.744779 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-55b3a29c-1f30-4eb0-83f7-9403590c897b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:50.745212 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-55b3a29c-1f30-4eb0-83f7-9403590c897b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:50.745905 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-55b3a29c-1f30-4eb0-83f7-9403590c897b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:50.746362 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-55b3a29c-1f30-4eb0-83f7-9403590c897b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:50.746788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-55b3a29c-1f30-4eb0-83f7-9403590c897b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:50.852746 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-81e828f1-4b73-4ac6-8746-63a10020c1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:50.860500 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-81e828f1-4b73-4ac6-8746-63a10020c1b3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.154268 Sep 05 12:23:50.861073 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 229/460] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:50 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:50.872572 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8557b15d-9799-4aaa-afc6-8f479f00d50a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:50.873358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-8557b15d-9799-4aaa-afc6-8f479f00d50a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:50.879488 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8557b15d-9799-4aaa-afc6-8f479f00d50a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:50.880057 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8557b15d-9799-4aaa-afc6-8f479f00d50a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:50.881189 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8557b15d-9799-4aaa-afc6-8f479f00d50a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:50.882465 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8557b15d-9799-4aaa-afc6-8f479f00d50a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:50.882966 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8557b15d-9799-4aaa-afc6-8f479f00d50a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:50.883407 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8557b15d-9799-4aaa-afc6-8f479f00d50a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:50.883549 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-55b3a29c-1f30-4eb0-83f7-9403590c897b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:50.891680 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-55b3a29c-1f30-4eb0-83f7-9403590c897b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:50.893146 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-55b3a29c-1f30-4eb0-83f7-9403590c897b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:50.894356 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-55b3a29c-1f30-4eb0-83f7-9403590c897b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1744 microversion: 2.20 time: 0.161621 Sep 05 12:23:50.898800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 232/461] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:50 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:23:51.015512 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8557b15d-9799-4aaa-afc6-8f479f00d50a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:51.023740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8557b15d-9799-4aaa-afc6-8f479f00d50a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.155010 Sep 05 12:23:51.024302 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 230/462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:50 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:51.883639 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-271169c8-0501-499c-8221-013051d7a91c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:51.884248 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-271169c8-0501-499c-8221-013051d7a91c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:51.890718 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-271169c8-0501-499c-8221-013051d7a91c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:51.891204 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-271169c8-0501-499c-8221-013051d7a91c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:51.891668 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-271169c8-0501-499c-8221-013051d7a91c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:51.892349 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-271169c8-0501-499c-8221-013051d7a91c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:51.892813 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-271169c8-0501-499c-8221-013051d7a91c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:51.893243 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-271169c8-0501-499c-8221-013051d7a91c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:51.921833 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-37f4fbcb-d03a-4a7a-a491-55f39695d42c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:51.922462 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-37f4fbcb-d03a-4a7a-a491-55f39695d42c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:51.929623 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37f4fbcb-d03a-4a7a-a491-55f39695d42c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:51.930116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37f4fbcb-d03a-4a7a-a491-55f39695d42c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:51.930538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37f4fbcb-d03a-4a7a-a491-55f39695d42c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:51.931238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37f4fbcb-d03a-4a7a-a491-55f39695d42c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:51.931712 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37f4fbcb-d03a-4a7a-a491-55f39695d42c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:51.932139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37f4fbcb-d03a-4a7a-a491-55f39695d42c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:52.026229 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-271169c8-0501-499c-8221-013051d7a91c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:52.033918 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-271169c8-0501-499c-8221-013051d7a91c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.154808 Sep 05 12:23:52.034494 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 233/463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:51 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:52.052324 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a9d2a2a6-a265-4097-b17f-397e332f4891 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:52.052947 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a9d2a2a6-a265-4097-b17f-397e332f4891 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:52.059546 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9d2a2a6-a265-4097-b17f-397e332f4891 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:52.060056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9d2a2a6-a265-4097-b17f-397e332f4891 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:52.060491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9d2a2a6-a265-4097-b17f-397e332f4891 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:52.061190 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9d2a2a6-a265-4097-b17f-397e332f4891 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:52.061651 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9d2a2a6-a265-4097-b17f-397e332f4891 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:52.062079 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9d2a2a6-a265-4097-b17f-397e332f4891 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:52.068369 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-37f4fbcb-d03a-4a7a-a491-55f39695d42c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:52.076554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-37f4fbcb-d03a-4a7a-a491-55f39695d42c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:52.078100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-37f4fbcb-d03a-4a7a-a491-55f39695d42c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:52.079348 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-37f4fbcb-d03a-4a7a-a491-55f39695d42c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1744 microversion: 2.20 time: 0.161338 Sep 05 12:23:52.080018 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 231/464] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:51 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:23:52.192659 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a9d2a2a6-a265-4097-b17f-397e332f4891 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:52.200863 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a9d2a2a6-a265-4097-b17f-397e332f4891 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.157402 Sep 05 12:23:52.201428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 234/465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:52 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:53.058313 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-cd926d46-f69a-4c11-bc19-68c79a990564 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:53.058948 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-cd926d46-f69a-4c11-bc19-68c79a990564 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:53.065611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cd926d46-f69a-4c11-bc19-68c79a990564 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:53.066103 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cd926d46-f69a-4c11-bc19-68c79a990564 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:53.066540 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cd926d46-f69a-4c11-bc19-68c79a990564 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:53.067247 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cd926d46-f69a-4c11-bc19-68c79a990564 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:53.067815 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cd926d46-f69a-4c11-bc19-68c79a990564 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:53.068250 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cd926d46-f69a-4c11-bc19-68c79a990564 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:53.208031 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-cd926d46-f69a-4c11-bc19-68c79a990564 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:53.215440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-be6db7dd-dcd5-4619-bcf6-de02632ac079 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:53.216005 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-cd926d46-f69a-4c11-bc19-68c79a990564 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.162114 Sep 05 12:23:53.216114 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-be6db7dd-dcd5-4619-bcf6-de02632ac079 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:53.216568 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 232/466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:53 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:53.222404 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-be6db7dd-dcd5-4619-bcf6-de02632ac079 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:53.222770 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1f213408-e940-4c2e-ab3a-e48070e7c2aa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:53.223081 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-be6db7dd-dcd5-4619-bcf6-de02632ac079 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:53.223380 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1f213408-e940-4c2e-ab3a-e48070e7c2aa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:53.223662 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-be6db7dd-dcd5-4619-bcf6-de02632ac079 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:53.224224 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-be6db7dd-dcd5-4619-bcf6-de02632ac079 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:53.224684 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-be6db7dd-dcd5-4619-bcf6-de02632ac079 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:53.225122 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-be6db7dd-dcd5-4619-bcf6-de02632ac079 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:53.230088 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f213408-e940-4c2e-ab3a-e48070e7c2aa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:53.230575 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f213408-e940-4c2e-ab3a-e48070e7c2aa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:53.231019 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f213408-e940-4c2e-ab3a-e48070e7c2aa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:53.231749 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f213408-e940-4c2e-ab3a-e48070e7c2aa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:53.232210 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f213408-e940-4c2e-ab3a-e48070e7c2aa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:53.232639 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1f213408-e940-4c2e-ab3a-e48070e7c2aa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:53.359759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-be6db7dd-dcd5-4619-bcf6-de02632ac079 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:53.364457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1f213408-e940-4c2e-ab3a-e48070e7c2aa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:53.368734 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-be6db7dd-dcd5-4619-bcf6-de02632ac079 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:53.370195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-be6db7dd-dcd5-4619-bcf6-de02632ac079 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:53.371369 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-be6db7dd-dcd5-4619-bcf6-de02632ac079 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1744 microversion: 2.20 time: 0.270880 Sep 05 12:23:53.374231 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 235/467] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:53 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1744 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:23:53.374919 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1f213408-e940-4c2e-ab3a-e48070e7c2aa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.154284 Sep 05 12:23:53.374919 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 233/468] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:53 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:54.239077 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c664f2f8-c3f0-4dce-93c9-762ca5bce60c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:54.239722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c664f2f8-c3f0-4dce-93c9-762ca5bce60c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:54.246341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c664f2f8-c3f0-4dce-93c9-762ca5bce60c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:54.246828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c664f2f8-c3f0-4dce-93c9-762ca5bce60c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:54.247267 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c664f2f8-c3f0-4dce-93c9-762ca5bce60c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:54.247995 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c664f2f8-c3f0-4dce-93c9-762ca5bce60c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:54.248450 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c664f2f8-c3f0-4dce-93c9-762ca5bce60c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:54.248870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c664f2f8-c3f0-4dce-93c9-762ca5bce60c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:54.397432 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-88cc71b9-212c-4823-9d54-6eb0fcfcab5b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:54.398107 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c664f2f8-c3f0-4dce-93c9-762ca5bce60c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:54.398241 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-88cc71b9-212c-4823-9d54-6eb0fcfcab5b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:54.406105 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-88cc71b9-212c-4823-9d54-6eb0fcfcab5b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:54.406593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-88cc71b9-212c-4823-9d54-6eb0fcfcab5b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:54.406871 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c664f2f8-c3f0-4dce-93c9-762ca5bce60c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.171578 Sep 05 12:23:54.407041 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-88cc71b9-212c-4823-9d54-6eb0fcfcab5b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:54.407456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 236/469] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:54 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:54.418160 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-88cc71b9-212c-4823-9d54-6eb0fcfcab5b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:54.418160 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-88cc71b9-212c-4823-9d54-6eb0fcfcab5b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:54.418160 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-88cc71b9-212c-4823-9d54-6eb0fcfcab5b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:54.418541 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a29fec5d-77e9-4d08-bd05-6dfa30b166c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:54.418541 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a29fec5d-77e9-4d08-bd05-6dfa30b166c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:54.419394 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a29fec5d-77e9-4d08-bd05-6dfa30b166c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:54.419925 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a29fec5d-77e9-4d08-bd05-6dfa30b166c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:54.420359 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a29fec5d-77e9-4d08-bd05-6dfa30b166c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:54.421174 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a29fec5d-77e9-4d08-bd05-6dfa30b166c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:54.422014 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a29fec5d-77e9-4d08-bd05-6dfa30b166c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:54.422262 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a29fec5d-77e9-4d08-bd05-6dfa30b166c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:54.560478 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-88cc71b9-212c-4823-9d54-6eb0fcfcab5b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:54.565352 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a29fec5d-77e9-4d08-bd05-6dfa30b166c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:54.568869 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-88cc71b9-212c-4823-9d54-6eb0fcfcab5b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:54.570825 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-88cc71b9-212c-4823-9d54-6eb0fcfcab5b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:54.572124 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-88cc71b9-212c-4823-9d54-6eb0fcfcab5b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1744 microversion: 2.20 time: 0.178819 Sep 05 12:23:54.572682 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 234/470] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:54 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:23:54.573973 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a29fec5d-77e9-4d08-bd05-6dfa30b166c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1724 microversion: 2.1 time: 0.165424 Sep 05 12:23:54.574560 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 237/471] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:54 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:55.432449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c6de5c70-e3cb-49f0-9f74-e18a36a29253 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:55.432978 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c6de5c70-e3cb-49f0-9f74-e18a36a29253 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:55.439248 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6de5c70-e3cb-49f0-9f74-e18a36a29253 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:55.439908 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6de5c70-e3cb-49f0-9f74-e18a36a29253 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:55.440353 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6de5c70-e3cb-49f0-9f74-e18a36a29253 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:55.441056 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6de5c70-e3cb-49f0-9f74-e18a36a29253 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:55.441512 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6de5c70-e3cb-49f0-9f74-e18a36a29253 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:55.441939 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6de5c70-e3cb-49f0-9f74-e18a36a29253 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:55.581725 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c6de5c70-e3cb-49f0-9f74-e18a36a29253 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:55.589869 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c6de5c70-e3cb-49f0-9f74-e18a36a29253 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.161186 Sep 05 12:23:55.590462 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 235/472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:55 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:55.598206 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a9179195-2134-4880-83e9-f2a0f1ab1273 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:55.598851 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a9179195-2134-4880-83e9-f2a0f1ab1273 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:55.603189 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0697d3e8-66af-4a4b-87d6-7f5e599506fe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:55.604097 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0697d3e8-66af-4a4b-87d6-7f5e599506fe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:55.606525 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9179195-2134-4880-83e9-f2a0f1ab1273 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:55.607256 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9179195-2134-4880-83e9-f2a0f1ab1273 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:55.607503 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9179195-2134-4880-83e9-f2a0f1ab1273 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:55.608232 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9179195-2134-4880-83e9-f2a0f1ab1273 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:55.608689 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9179195-2134-4880-83e9-f2a0f1ab1273 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:55.609120 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9179195-2134-4880-83e9-f2a0f1ab1273 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:55.611140 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0697d3e8-66af-4a4b-87d6-7f5e599506fe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:55.611698 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0697d3e8-66af-4a4b-87d6-7f5e599506fe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:55.612112 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0697d3e8-66af-4a4b-87d6-7f5e599506fe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:55.612855 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0697d3e8-66af-4a4b-87d6-7f5e599506fe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:55.614494 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0697d3e8-66af-4a4b-87d6-7f5e599506fe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:55.614494 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0697d3e8-66af-4a4b-87d6-7f5e599506fe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:55.761554 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a9179195-2134-4880-83e9-f2a0f1ab1273 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:55.771250 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a9179195-2134-4880-83e9-f2a0f1ab1273 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1701 microversion: 2.1 time: 0.177500 Sep 05 12:23:55.772771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 238/473] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:55 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1701 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:55.777827 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-101193541", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "networks": [{"uuid": "5f030554-440f-4d71-a209-929c7d0f2616"}]}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:55.816281 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0697d3e8-66af-4a4b-87d6-7f5e599506fe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:55.825672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0697d3e8-66af-4a4b-87d6-7f5e599506fe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:55.829338 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0697d3e8-66af-4a4b-87d6-7f5e599506fe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:55.831088 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0697d3e8-66af-4a4b-87d6-7f5e599506fe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1744 microversion: 2.20 time: 0.231906 Sep 05 12:23:55.832410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 236/474] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:55 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1744 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:55.838431 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-10361168-0087-4115-8c21-ff20e6e7ac4a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:55.845401 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-10361168-0087-4115-8c21-ff20e6e7ac4a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:55.846185 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-10361168-0087-4115-8c21-ff20e6e7ac4a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:55.847004 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-10361168-0087-4115-8c21-ff20e6e7ac4a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:55.862835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.network.neutron [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] validate_networks() for [('5f030554-440f-4d71-a209-929c7d0f2616', None, None, None, None, None)] {{(pid=120535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:23:55.874371 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-10361168-0087-4115-8c21-ff20e6e7ac4a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Going to try to start instance {{(pid=120534) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 05 12:23:55.902027 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:55.933340 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-10361168-0087-4115-8c21-ff20e6e7ac4a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "POST /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/action" status: 202 len: 0 microversion: 2.1 time: 0.099049 Sep 05 12:23:55.934265 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 237/475] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Sep 5 12:23:55 2022] POST /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:23:55.943389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-20148ac5-b9d9-4fd5-83b0-036a44e469ea tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:55.944294 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-20148ac5-b9d9-4fd5-83b0-036a44e469ea tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:55.951214 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-20148ac5-b9d9-4fd5-83b0-036a44e469ea tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:55.951838 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-20148ac5-b9d9-4fd5-83b0-036a44e469ea tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:55.952354 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-20148ac5-b9d9-4fd5-83b0-036a44e469ea tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:55.953340 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-20148ac5-b9d9-4fd5-83b0-036a44e469ea tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:55.954042 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-20148ac5-b9d9-4fd5-83b0-036a44e469ea tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:55.955053 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-20148ac5-b9d9-4fd5-83b0-036a44e469ea tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:56.106604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-20148ac5-b9d9-4fd5-83b0-036a44e469ea tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:56.114937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-20148ac5-b9d9-4fd5-83b0-036a44e469ea tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1710 microversion: 2.1 time: 0.175884 Sep 05 12:23:56.115509 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 238/476] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:55 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1710 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:56.243866 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Flavor limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:23:56.244291 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Image limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:23:56.244758 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Flavor pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:23:56.245169 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Image pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:23:56.245577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:23:56.254665 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:56.255257 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:56.255789 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:56.257254 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:56.257709 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:56.258131 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:56.269218 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=100 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:56.276185 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Getting quotas for project 57a93fc888a145c88b28b8b73060731e. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:23:56.281070 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Getting quotas for user 4e187162f3e64acdb8cd24f660ceeca6 and project 57a93fc888a145c88b28b8b73060731e. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:23:56.297221 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Going to run 1 instances... {{(pid=120535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:23:56.299557 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:23:56.347352 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7481d7fd-caf5-41e4-9766-a08ad5cc652c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572849 Sep 05 12:23:56.347636 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 239/477] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:23:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:23:56.359021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5b7ea0c7-91e8-44d5-af19-2d1e09ac5c60 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:56.359976 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5b7ea0c7-91e8-44d5-af19-2d1e09ac5c60 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:56.420633 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5b7ea0c7-91e8-44d5-af19-2d1e09ac5c60 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:56.427695 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5b7ea0c7-91e8-44d5-af19-2d1e09ac5c60 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1218 microversion: 2.1 time: 0.072798 Sep 05 12:23:56.429196 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 239/478] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:56 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:56.613778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ec345bcf-f4e4-4aac-a3ac-3efffc0cabe2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:56.614380 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ec345bcf-f4e4-4aac-a3ac-3efffc0cabe2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:56.622032 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ec345bcf-f4e4-4aac-a3ac-3efffc0cabe2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:56.622555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ec345bcf-f4e4-4aac-a3ac-3efffc0cabe2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:56.623081 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ec345bcf-f4e4-4aac-a3ac-3efffc0cabe2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:56.623990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ec345bcf-f4e4-4aac-a3ac-3efffc0cabe2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:56.624536 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ec345bcf-f4e4-4aac-a3ac-3efffc0cabe2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:56.625089 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ec345bcf-f4e4-4aac-a3ac-3efffc0cabe2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:56.762917 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ec345bcf-f4e4-4aac-a3ac-3efffc0cabe2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:56.774860 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ec345bcf-f4e4-4aac-a3ac-3efffc0cabe2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.165328 Sep 05 12:23:56.775442 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 240/479] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:56 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:56.857980 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-34df9344-420e-4857-b4d7-f751b22c6666 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:56.859294 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-34df9344-420e-4857-b4d7-f751b22c6666 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:56.875840 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-34df9344-420e-4857-b4d7-f751b22c6666 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:56.876320 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-34df9344-420e-4857-b4d7-f751b22c6666 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:56.876752 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-34df9344-420e-4857-b4d7-f751b22c6666 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:56.877468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-34df9344-420e-4857-b4d7-f751b22c6666 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:56.877946 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-34df9344-420e-4857-b4d7-f751b22c6666 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:56.878347 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-34df9344-420e-4857-b4d7-f751b22c6666 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:57.021975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-34df9344-420e-4857-b4d7-f751b22c6666 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:57.031085 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-34df9344-420e-4857-b4d7-f751b22c6666 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:57.032536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-34df9344-420e-4857-b4d7-f751b22c6666 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:57.033694 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-34df9344-420e-4857-b4d7-f751b22c6666 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1744 microversion: 2.20 time: 0.179861 Sep 05 12:23:57.034246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 240/480] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:56 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:57.139040 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-eac24264-550c-40c9-b58c-bf9ccc759b89 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:57.139710 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-eac24264-550c-40c9-b58c-bf9ccc759b89 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:57.145934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eac24264-550c-40c9-b58c-bf9ccc759b89 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:57.146422 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eac24264-550c-40c9-b58c-bf9ccc759b89 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:57.146861 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eac24264-550c-40c9-b58c-bf9ccc759b89 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:57.148137 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eac24264-550c-40c9-b58c-bf9ccc759b89 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:57.148599 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eac24264-550c-40c9-b58c-bf9ccc759b89 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:57.149035 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eac24264-550c-40c9-b58c-bf9ccc759b89 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:57.288470 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-eac24264-550c-40c9-b58c-bf9ccc759b89 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:57.296524 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-eac24264-550c-40c9-b58c-bf9ccc759b89 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1710 microversion: 2.1 time: 0.161470 Sep 05 12:23:57.297088 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 241/481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:57 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:57.450883 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f6b2efa6-4ce5-49c7-a141-581e2f2afcf5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:57.451872 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f6b2efa6-4ce5-49c7-a141-581e2f2afcf5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:57.457912 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6b2efa6-4ce5-49c7-a141-581e2f2afcf5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:57.458400 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6b2efa6-4ce5-49c7-a141-581e2f2afcf5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:57.458842 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6b2efa6-4ce5-49c7-a141-581e2f2afcf5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:57.459559 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6b2efa6-4ce5-49c7-a141-581e2f2afcf5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:57.460611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6b2efa6-4ce5-49c7-a141-581e2f2afcf5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:57.461046 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6b2efa6-4ce5-49c7-a141-581e2f2afcf5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:57.521844 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f6b2efa6-4ce5-49c7-a141-581e2f2afcf5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:57.530602 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f6b2efa6-4ce5-49c7-a141-581e2f2afcf5 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1214 microversion: 2.1 time: 0.083765 Sep 05 12:23:57.531168 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 241/482] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:57 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:57.803059 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8b63c03a-653c-40d2-b8a4-df748b62b845 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:57.803783 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8b63c03a-653c-40d2-b8a4-df748b62b845 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:57.810185 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8b63c03a-653c-40d2-b8a4-df748b62b845 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:57.810674 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8b63c03a-653c-40d2-b8a4-df748b62b845 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:57.811107 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8b63c03a-653c-40d2-b8a4-df748b62b845 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:57.811828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8b63c03a-653c-40d2-b8a4-df748b62b845 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:57.812281 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8b63c03a-653c-40d2-b8a4-df748b62b845 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:57.812707 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8b63c03a-653c-40d2-b8a4-df748b62b845 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:57.916843 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-3acf9f1f-5788-42fe-be57-ca75813b6a84 req-dd43bf0d-495f-4bd3-acfc-6bfaeda9024e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78cd9ae3-2a60-4905-a291-30169e41c86c", "name": "network-vif-plugged", "status": "completed", "tag": "6a5ea4f2-8220-4378-84c2-dc1b033a8dd0"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:23:57.928553 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-3acf9f1f-5788-42fe-be57-ca75813b6a84 req-dd43bf0d-495f-4bd3-acfc-6bfaeda9024e service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:57.929164 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-3acf9f1f-5788-42fe-be57-ca75813b6a84 req-dd43bf0d-495f-4bd3-acfc-6bfaeda9024e service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:57.929697 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-3acf9f1f-5788-42fe-be57-ca75813b6a84 req-dd43bf0d-495f-4bd3-acfc-6bfaeda9024e service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:57.942811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-3acf9f1f-5788-42fe-be57-ca75813b6a84 req-dd43bf0d-495f-4bd3-acfc-6bfaeda9024e service nova] Creating event network-vif-plugged:6a5ea4f2-8220-4378-84c2-dc1b033a8dd0 for instance 78cd9ae3-2a60-4905-a291-30169e41c86c on hv-cinder-85518 Sep 05 12:23:57.950403 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8b63c03a-653c-40d2-b8a4-df748b62b845 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:57.958264 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8b63c03a-653c-40d2-b8a4-df748b62b845 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1261 microversion: 2.1 time: 0.159034 Sep 05 12:23:57.959411 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-3acf9f1f-5788-42fe-be57-ca75813b6a84 req-dd43bf0d-495f-4bd3-acfc-6bfaeda9024e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046399 Sep 05 12:23:57.960917 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 242/483] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:23:57.961400 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 242/484] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:57 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:58.060714 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c93b0dcb-ab8e-47f2-87d2-5475f9e2ba60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:58.061569 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c93b0dcb-ab8e-47f2-87d2-5475f9e2ba60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:58.067903 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c93b0dcb-ab8e-47f2-87d2-5475f9e2ba60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:58.068381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c93b0dcb-ab8e-47f2-87d2-5475f9e2ba60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:58.068854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c93b0dcb-ab8e-47f2-87d2-5475f9e2ba60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:58.070202 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c93b0dcb-ab8e-47f2-87d2-5475f9e2ba60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:58.070657 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c93b0dcb-ab8e-47f2-87d2-5475f9e2ba60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:58.071113 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c93b0dcb-ab8e-47f2-87d2-5475f9e2ba60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:58.313364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c93b0dcb-ab8e-47f2-87d2-5475f9e2ba60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:58.323903 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a04733a2-d098-4baa-a197-0cd11208a6c3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:58.324530 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a04733a2-d098-4baa-a197-0cd11208a6c3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:58.332670 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c93b0dcb-ab8e-47f2-87d2-5475f9e2ba60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:58.333335 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a04733a2-d098-4baa-a197-0cd11208a6c3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:58.333877 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a04733a2-d098-4baa-a197-0cd11208a6c3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:58.334499 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a04733a2-d098-4baa-a197-0cd11208a6c3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:58.335660 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a04733a2-d098-4baa-a197-0cd11208a6c3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:58.336262 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a04733a2-d098-4baa-a197-0cd11208a6c3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:58.336697 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a04733a2-d098-4baa-a197-0cd11208a6c3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:58.337898 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c93b0dcb-ab8e-47f2-87d2-5475f9e2ba60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:58.338888 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c93b0dcb-ab8e-47f2-87d2-5475f9e2ba60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1739 microversion: 2.20 time: 0.282542 Sep 05 12:23:58.341269 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 243/485] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:58 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:58.489621 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a04733a2-d098-4baa-a197-0cd11208a6c3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:58.498842 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a04733a2-d098-4baa-a197-0cd11208a6c3 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1710 microversion: 2.1 time: 0.183160 Sep 05 12:23:58.499455 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 243/486] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:58 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1710 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:23:58.554010 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9eecfed3-0bbb-4b1b-9235-f1ac900a85f9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:58.554632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9eecfed3-0bbb-4b1b-9235-f1ac900a85f9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:58.560618 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9eecfed3-0bbb-4b1b-9235-f1ac900a85f9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:58.561096 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9eecfed3-0bbb-4b1b-9235-f1ac900a85f9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:58.561526 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9eecfed3-0bbb-4b1b-9235-f1ac900a85f9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:58.562207 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9eecfed3-0bbb-4b1b-9235-f1ac900a85f9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:58.562657 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9eecfed3-0bbb-4b1b-9235-f1ac900a85f9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:58.563103 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9eecfed3-0bbb-4b1b-9235-f1ac900a85f9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:58.624743 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9eecfed3-0bbb-4b1b-9235-f1ac900a85f9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:58.632297 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9eecfed3-0bbb-4b1b-9235-f1ac900a85f9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1270 microversion: 2.1 time: 0.082802 Sep 05 12:23:58.632856 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 244/487] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:58 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:58.983258 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-99d31003-cb14-41bf-b1cb-a5f2a46e4d20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:58.983914 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-99d31003-cb14-41bf-b1cb-a5f2a46e4d20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:58.992020 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-99d31003-cb14-41bf-b1cb-a5f2a46e4d20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:58.992749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-99d31003-cb14-41bf-b1cb-a5f2a46e4d20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:58.993186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-99d31003-cb14-41bf-b1cb-a5f2a46e4d20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:58.993874 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-99d31003-cb14-41bf-b1cb-a5f2a46e4d20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:58.994322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-99d31003-cb14-41bf-b1cb-a5f2a46e4d20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:58.994950 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-99d31003-cb14-41bf-b1cb-a5f2a46e4d20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:59.154594 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-99d31003-cb14-41bf-b1cb-a5f2a46e4d20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:59.162277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-99d31003-cb14-41bf-b1cb-a5f2a46e4d20 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1444 microversion: 2.1 time: 0.183135 Sep 05 12:23:59.163573 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 244/488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:58 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1444 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:59.186577 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-bf7dc0c3-9276-412d-9d47-02836232cdf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:59.187195 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-bf7dc0c3-9276-412d-9d47-02836232cdf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:59.195293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bf7dc0c3-9276-412d-9d47-02836232cdf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:59.195836 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bf7dc0c3-9276-412d-9d47-02836232cdf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:59.196275 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bf7dc0c3-9276-412d-9d47-02836232cdf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:59.196978 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bf7dc0c3-9276-412d-9d47-02836232cdf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:59.197433 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bf7dc0c3-9276-412d-9d47-02836232cdf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:59.197865 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bf7dc0c3-9276-412d-9d47-02836232cdf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:59.349657 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-bf7dc0c3-9276-412d-9d47-02836232cdf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:59.358273 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-bf7dc0c3-9276-412d-9d47-02836232cdf9 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1444 microversion: 2.1 time: 0.175447 Sep 05 12:23:59.359132 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 245/489] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:59 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1444 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:59.366430 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7106872b-49e4-4347-aabb-e2a3f000e8af tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:59.367142 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7106872b-49e4-4347-aabb-e2a3f000e8af tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:59.373709 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7106872b-49e4-4347-aabb-e2a3f000e8af tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:59.374505 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7106872b-49e4-4347-aabb-e2a3f000e8af tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:59.375185 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7106872b-49e4-4347-aabb-e2a3f000e8af tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:59.376138 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7106872b-49e4-4347-aabb-e2a3f000e8af tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:59.376842 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7106872b-49e4-4347-aabb-e2a3f000e8af tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:59.377600 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7106872b-49e4-4347-aabb-e2a3f000e8af tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:59.525313 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-47a1381f-2c30-4306-99b2-dd6d2b1431fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:59.526482 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-47a1381f-2c30-4306-99b2-dd6d2b1431fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:59.540021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-47a1381f-2c30-4306-99b2-dd6d2b1431fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:59.540503 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-47a1381f-2c30-4306-99b2-dd6d2b1431fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:59.541159 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-47a1381f-2c30-4306-99b2-dd6d2b1431fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:59.542105 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-47a1381f-2c30-4306-99b2-dd6d2b1431fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:59.543359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-47a1381f-2c30-4306-99b2-dd6d2b1431fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:59.544023 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-47a1381f-2c30-4306-99b2-dd6d2b1431fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:59.677579 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-7106872b-49e4-4347-aabb-e2a3f000e8af tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:59.695789 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-7106872b-49e4-4347-aabb-e2a3f000e8af tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:59.698019 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-7106872b-49e4-4347-aabb-e2a3f000e8af tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:59.701174 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7106872b-49e4-4347-aabb-e2a3f000e8af tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1739 microversion: 2.20 time: 0.336800 Sep 05 12:23:59.720185 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 245/490] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:23:59 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:59.727244 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-11010533-0723-442e-8730-696e81ed9b30 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:59.728091 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-11010533-0723-442e-8730-696e81ed9b30 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:23:59.736505 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-11010533-0723-442e-8730-696e81ed9b30 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:59.737301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-11010533-0723-442e-8730-696e81ed9b30 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:59.737906 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-11010533-0723-442e-8730-696e81ed9b30 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:59.747706 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-11010533-0723-442e-8730-696e81ed9b30 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:23:59.753080 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-11010533-0723-442e-8730-696e81ed9b30 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:23:59.753908 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-11010533-0723-442e-8730-696e81ed9b30 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:23:59.842113 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-47a1381f-2c30-4306-99b2-dd6d2b1431fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:59.874626 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-11010533-0723-442e-8730-696e81ed9b30 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:23:59.884556 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-47a1381f-2c30-4306-99b2-dd6d2b1431fb tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1710 microversion: 2.1 time: 0.364693 Sep 05 12:23:59.885172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 246/491] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:59 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1710 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:59.891167 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-11010533-0723-442e-8730-696e81ed9b30 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1288 microversion: 2.1 time: 0.169428 Sep 05 12:23:59.892030 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 246/492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:23:59 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1288 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:24:00.733055 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-eed4bb24-caa3-4fba-9425-4b60b098f1fa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:00.734560 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-eed4bb24-caa3-4fba-9425-4b60b098f1fa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:00.742551 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:00.745630 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eed4bb24-caa3-4fba-9425-4b60b098f1fa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:00.747208 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eed4bb24-caa3-4fba-9425-4b60b098f1fa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:00.747899 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eed4bb24-caa3-4fba-9425-4b60b098f1fa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:00.749098 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eed4bb24-caa3-4fba-9425-4b60b098f1fa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:00.749793 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eed4bb24-caa3-4fba-9425-4b60b098f1fa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:00.750436 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eed4bb24-caa3-4fba-9425-4b60b098f1fa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:00.908324 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7bccc24a-96ee-42ac-9fa3-95e2a1a4e591 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:00.909538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7bccc24a-96ee-42ac-9fa3-95e2a1a4e591 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:00.925029 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7bccc24a-96ee-42ac-9fa3-95e2a1a4e591 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:00.925451 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7bccc24a-96ee-42ac-9fa3-95e2a1a4e591 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:00.928173 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7bccc24a-96ee-42ac-9fa3-95e2a1a4e591 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:00.928974 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7bccc24a-96ee-42ac-9fa3-95e2a1a4e591 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:00.929440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7bccc24a-96ee-42ac-9fa3-95e2a1a4e591 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:00.929871 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7bccc24a-96ee-42ac-9fa3-95e2a1a4e591 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:00.959187 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-eed4bb24-caa3-4fba-9425-4b60b098f1fa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:00.973070 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-eed4bb24-caa3-4fba-9425-4b60b098f1fa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:00.978259 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-eed4bb24-caa3-4fba-9425-4b60b098f1fa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:00.980503 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-eed4bb24-caa3-4fba-9425-4b60b098f1fa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1739 microversion: 2.20 time: 0.250513 Sep 05 12:24:00.999062 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 247/493] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:00 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:01.010125 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5d8770fa-2a00-40e4-ab13-457fc4fa2905 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:01.010748 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5d8770fa-2a00-40e4-ab13-457fc4fa2905 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:01.017486 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5d8770fa-2a00-40e4-ab13-457fc4fa2905 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:01.017980 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5d8770fa-2a00-40e4-ab13-457fc4fa2905 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:01.018593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5d8770fa-2a00-40e4-ab13-457fc4fa2905 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:01.019803 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5d8770fa-2a00-40e4-ab13-457fc4fa2905 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:01.020471 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5d8770fa-2a00-40e4-ab13-457fc4fa2905 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:01.021111 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5d8770fa-2a00-40e4-ab13-457fc4fa2905 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:01.227893 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5d8770fa-2a00-40e4-ab13-457fc4fa2905 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:01.265290 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5d8770fa-2a00-40e4-ab13-457fc4fa2905 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1318 microversion: 2.1 time: 0.259361 Sep 05 12:24:01.268610 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 248/494] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:00 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:24:01.787656 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-7bccc24a-96ee-42ac-9fa3-95e2a1a4e591 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:01.800211 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7bccc24a-96ee-42ac-9fa3-95e2a1a4e591 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1710 microversion: 2.1 time: 0.895350 Sep 05 12:24:01.800211 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 247/495] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:00 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1710 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:24:02.015986 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-6a2d722e-226a-415e-9f0b-e7d3261e235d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:02.017071 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-6a2d722e-226a-415e-9f0b-e7d3261e235d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:02.028248 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6a2d722e-226a-415e-9f0b-e7d3261e235d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:02.029303 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6a2d722e-226a-415e-9f0b-e7d3261e235d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:02.029871 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6a2d722e-226a-415e-9f0b-e7d3261e235d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:02.030719 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6a2d722e-226a-415e-9f0b-e7d3261e235d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:02.031283 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6a2d722e-226a-415e-9f0b-e7d3261e235d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:02.031856 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6a2d722e-226a-415e-9f0b-e7d3261e235d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:02.226619 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6a2d722e-226a-415e-9f0b-e7d3261e235d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:02.247026 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6a2d722e-226a-415e-9f0b-e7d3261e235d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:02.248681 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6a2d722e-226a-415e-9f0b-e7d3261e235d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:02.250145 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-6a2d722e-226a-415e-9f0b-e7d3261e235d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1739 microversion: 2.20 time: 0.241081 Sep 05 12:24:02.250988 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 249/496] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:02 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:02.293611 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-451621bf-e6ca-48bb-9f0a-c5d0d181bf76 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:02.294861 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-451621bf-e6ca-48bb-9f0a-c5d0d181bf76 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:02.302501 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-451621bf-e6ca-48bb-9f0a-c5d0d181bf76 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:02.303900 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-451621bf-e6ca-48bb-9f0a-c5d0d181bf76 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:02.304566 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-451621bf-e6ca-48bb-9f0a-c5d0d181bf76 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:02.305506 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-451621bf-e6ca-48bb-9f0a-c5d0d181bf76 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:02.306218 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-451621bf-e6ca-48bb-9f0a-c5d0d181bf76 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:02.307024 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-451621bf-e6ca-48bb-9f0a-c5d0d181bf76 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:02.802657 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-451621bf-e6ca-48bb-9f0a-c5d0d181bf76 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:02.804840 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=100 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:02.838711 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-451621bf-e6ca-48bb-9f0a-c5d0d181bf76 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1318 microversion: 2.1 time: 0.538463 Sep 05 12:24:02.838967 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b52c897d-be17-4899-a32c-13f09616220f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:02.838967 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b52c897d-be17-4899-a32c-13f09616220f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:02.840369 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 248/497] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:02 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:24:02.855980 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b52c897d-be17-4899-a32c-13f09616220f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:02.857035 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b52c897d-be17-4899-a32c-13f09616220f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:02.857857 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b52c897d-be17-4899-a32c-13f09616220f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:02.859342 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b52c897d-be17-4899-a32c-13f09616220f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:02.860390 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b52c897d-be17-4899-a32c-13f09616220f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:02.861187 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b52c897d-be17-4899-a32c-13f09616220f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:03.050734 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b52c897d-be17-4899-a32c-13f09616220f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:03.065393 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b52c897d-be17-4899-a32c-13f09616220f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1714 microversion: 2.1 time: 0.246137 Sep 05 12:24:03.066589 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 250/498] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:02 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1714 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:24:03.280123 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5b835fb9-7699-4a06-aa79-c659c0e7d0f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:03.281758 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5b835fb9-7699-4a06-aa79-c659c0e7d0f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:03.295239 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b835fb9-7699-4a06-aa79-c659c0e7d0f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:03.296005 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b835fb9-7699-4a06-aa79-c659c0e7d0f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:03.296492 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b835fb9-7699-4a06-aa79-c659c0e7d0f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:03.297568 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b835fb9-7699-4a06-aa79-c659c0e7d0f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:03.298246 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b835fb9-7699-4a06-aa79-c659c0e7d0f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:03.298793 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b835fb9-7699-4a06-aa79-c659c0e7d0f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:03.577196 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5b835fb9-7699-4a06-aa79-c659c0e7d0f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:03.595631 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5b835fb9-7699-4a06-aa79-c659c0e7d0f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:03.597817 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5b835fb9-7699-4a06-aa79-c659c0e7d0f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:03.599485 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5b835fb9-7699-4a06-aa79-c659c0e7d0f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1739 microversion: 2.20 time: 0.326713 Sep 05 12:24:03.618463 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 249/499] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:03 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1739 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:03.662302 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-8679eea5-8fef-4eb7-b0f6-0337481271e5 req-903c72ed-5a98-4e34-9491-bdf2dfcad639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6911e31-cf61-4f60-a234-f90a7678e930", "tag": "490cb85a-153f-4bf1-a83d-4ca81c9e81a7"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:24:03.677390 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-8679eea5-8fef-4eb7-b0f6-0337481271e5 req-903c72ed-5a98-4e34-9491-bdf2dfcad639 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:03.679689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-8679eea5-8fef-4eb7-b0f6-0337481271e5 req-903c72ed-5a98-4e34-9491-bdf2dfcad639 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:03.680436 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-8679eea5-8fef-4eb7-b0f6-0337481271e5 req-903c72ed-5a98-4e34-9491-bdf2dfcad639 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:03.701971 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-8679eea5-8fef-4eb7-b0f6-0337481271e5 req-903c72ed-5a98-4e34-9491-bdf2dfcad639 service nova] Creating event network-changed:490cb85a-153f-4bf1-a83d-4ca81c9e81a7 for instance f6911e31-cf61-4f60-a234-f90a7678e930 on hv-cinder-85518 Sep 05 12:24:03.712334 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-8679eea5-8fef-4eb7-b0f6-0337481271e5 req-903c72ed-5a98-4e34-9491-bdf2dfcad639 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061073 Sep 05 12:24:03.713786 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 251/500] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:24:03.852615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-536dea81-d85b-4ded-a461-11dd266b9c4b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:03.853599 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-536dea81-d85b-4ded-a461-11dd266b9c4b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:03.860977 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-536dea81-d85b-4ded-a461-11dd266b9c4b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:03.862541 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-536dea81-d85b-4ded-a461-11dd266b9c4b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:03.862541 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-536dea81-d85b-4ded-a461-11dd266b9c4b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:03.863220 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-536dea81-d85b-4ded-a461-11dd266b9c4b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:03.863768 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-536dea81-d85b-4ded-a461-11dd266b9c4b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:03.864195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-536dea81-d85b-4ded-a461-11dd266b9c4b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:04.160948 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-536dea81-d85b-4ded-a461-11dd266b9c4b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:04.170899 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-536dea81-d85b-4ded-a461-11dd266b9c4b tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1318 microversion: 2.1 time: 0.323095 Sep 05 12:24:04.171822 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 250/501] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:03 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:24:04.629998 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-63f655c4-6b4a-485f-8d41-083e1342714a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:04.631731 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-63f655c4-6b4a-485f-8d41-083e1342714a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:04.647762 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-63f655c4-6b4a-485f-8d41-083e1342714a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:04.648569 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-63f655c4-6b4a-485f-8d41-083e1342714a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:04.649755 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-63f655c4-6b4a-485f-8d41-083e1342714a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:04.651027 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-63f655c4-6b4a-485f-8d41-083e1342714a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:04.651679 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-63f655c4-6b4a-485f-8d41-083e1342714a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:04.652292 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-63f655c4-6b4a-485f-8d41-083e1342714a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:04.822331 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-63f655c4-6b4a-485f-8d41-083e1342714a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:04.834403 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-63f655c4-6b4a-485f-8d41-083e1342714a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:04.836077 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-63f655c4-6b4a-485f-8d41-083e1342714a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:04.837366 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-63f655c4-6b4a-485f-8d41-083e1342714a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1739 microversion: 2.20 time: 0.212977 Sep 05 12:24:04.856914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 252/502] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:04 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:05.196416 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c319031e-8002-4cc2-838c-66192d3a73a1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:05.199902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c319031e-8002-4cc2-838c-66192d3a73a1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:05.208054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c319031e-8002-4cc2-838c-66192d3a73a1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:05.208713 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c319031e-8002-4cc2-838c-66192d3a73a1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:05.209233 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c319031e-8002-4cc2-838c-66192d3a73a1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:05.210043 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c319031e-8002-4cc2-838c-66192d3a73a1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:05.210555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c319031e-8002-4cc2-838c-66192d3a73a1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:05.211040 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c319031e-8002-4cc2-838c-66192d3a73a1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:05.354729 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c319031e-8002-4cc2-838c-66192d3a73a1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:05.365022 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c319031e-8002-4cc2-838c-66192d3a73a1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1318 microversion: 2.1 time: 0.172623 Sep 05 12:24:05.365821 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 251/503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:05 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:24:05.730547 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-d7adc676-d91f-44ed-ad68-a787e01ae1f9 req-0e84fa8e-8cfb-466c-a465-2c5563acb7fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4181d872-fbd4-4b16-b8c2-d086dd1253b2", "tag": "935d1954-274e-487a-b68a-696df548ac2a"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:24:05.743195 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-d7adc676-d91f-44ed-ad68-a787e01ae1f9 req-0e84fa8e-8cfb-466c-a465-2c5563acb7fa service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:05.743578 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-d7adc676-d91f-44ed-ad68-a787e01ae1f9 req-0e84fa8e-8cfb-466c-a465-2c5563acb7fa service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:05.743784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-d7adc676-d91f-44ed-ad68-a787e01ae1f9 req-0e84fa8e-8cfb-466c-a465-2c5563acb7fa service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:05.756748 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-d7adc676-d91f-44ed-ad68-a787e01ae1f9 req-0e84fa8e-8cfb-466c-a465-2c5563acb7fa service nova] Creating event network-changed:935d1954-274e-487a-b68a-696df548ac2a for instance 4181d872-fbd4-4b16-b8c2-d086dd1253b2 on hv-cinder-85518 Sep 05 12:24:05.761833 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-d7adc676-d91f-44ed-ad68-a787e01ae1f9 req-0e84fa8e-8cfb-466c-a465-2c5563acb7fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035061 Sep 05 12:24:05.762429 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 253/504] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:24:05.872571 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f0519dd1-f8a7-45a4-ba55-c50d497c1a3a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:05.873097 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f0519dd1-f8a7-45a4-ba55-c50d497c1a3a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:05.880037 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f0519dd1-f8a7-45a4-ba55-c50d497c1a3a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:05.880541 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f0519dd1-f8a7-45a4-ba55-c50d497c1a3a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:05.880969 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f0519dd1-f8a7-45a4-ba55-c50d497c1a3a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:05.881658 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f0519dd1-f8a7-45a4-ba55-c50d497c1a3a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:05.882182 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f0519dd1-f8a7-45a4-ba55-c50d497c1a3a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:05.882583 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f0519dd1-f8a7-45a4-ba55-c50d497c1a3a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:06.026596 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f0519dd1-f8a7-45a4-ba55-c50d497c1a3a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:06.034967 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f0519dd1-f8a7-45a4-ba55-c50d497c1a3a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:06.036488 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f0519dd1-f8a7-45a4-ba55-c50d497c1a3a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:06.037725 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f0519dd1-f8a7-45a4-ba55-c50d497c1a3a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1739 microversion: 2.20 time: 0.169447 Sep 05 12:24:06.038789 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 252/505] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:05 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:06.389547 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4e1c63e6-fe7a-4f04-b1cc-1aba6e5d60c6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:06.390256 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4e1c63e6-fe7a-4f04-b1cc-1aba6e5d60c6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:06.397913 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4e1c63e6-fe7a-4f04-b1cc-1aba6e5d60c6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:06.398434 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4e1c63e6-fe7a-4f04-b1cc-1aba6e5d60c6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:06.398877 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4e1c63e6-fe7a-4f04-b1cc-1aba6e5d60c6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:06.399626 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4e1c63e6-fe7a-4f04-b1cc-1aba6e5d60c6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:06.400089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4e1c63e6-fe7a-4f04-b1cc-1aba6e5d60c6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:06.400542 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4e1c63e6-fe7a-4f04-b1cc-1aba6e5d60c6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:06.425176 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:06.550189 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4e1c63e6-fe7a-4f04-b1cc-1aba6e5d60c6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:06.558361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4e1c63e6-fe7a-4f04-b1cc-1aba6e5d60c6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1318 microversion: 2.1 time: 0.173208 Sep 05 12:24:06.559432 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 254/506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:06 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:24:07.073274 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-bd519d71-52ea-44d1-9ac7-e4dedc24902b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:07.074080 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-bd519d71-52ea-44d1-9ac7-e4dedc24902b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:07.076847 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:07.077631 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=6 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:07.084438 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bd519d71-52ea-44d1-9ac7-e4dedc24902b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:07.085031 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bd519d71-52ea-44d1-9ac7-e4dedc24902b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:07.085535 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bd519d71-52ea-44d1-9ac7-e4dedc24902b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:07.086314 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bd519d71-52ea-44d1-9ac7-e4dedc24902b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:07.086837 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bd519d71-52ea-44d1-9ac7-e4dedc24902b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:07.087333 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bd519d71-52ea-44d1-9ac7-e4dedc24902b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:07.241094 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-bd519d71-52ea-44d1-9ac7-e4dedc24902b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:07.261464 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-bd519d71-52ea-44d1-9ac7-e4dedc24902b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:07.264277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-bd519d71-52ea-44d1-9ac7-e4dedc24902b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:07.266350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-bd519d71-52ea-44d1-9ac7-e4dedc24902b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1739 microversion: 2.20 time: 0.205924 Sep 05 12:24:07.267287 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 253/507] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:07 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:07.583092 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0adefe4f-0e0e-4939-acc8-09c9c60be15c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:07.585374 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0adefe4f-0e0e-4939-acc8-09c9c60be15c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:07.600417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0adefe4f-0e0e-4939-acc8-09c9c60be15c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:07.601243 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0adefe4f-0e0e-4939-acc8-09c9c60be15c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:07.601871 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0adefe4f-0e0e-4939-acc8-09c9c60be15c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:07.611606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0adefe4f-0e0e-4939-acc8-09c9c60be15c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:07.612963 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0adefe4f-0e0e-4939-acc8-09c9c60be15c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:07.613978 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0adefe4f-0e0e-4939-acc8-09c9c60be15c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:08.139119 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0adefe4f-0e0e-4939-acc8-09c9c60be15c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:08.165163 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0adefe4f-0e0e-4939-acc8-09c9c60be15c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1318 microversion: 2.1 time: 0.582337 Sep 05 12:24:08.179712 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 255/508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:07 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1318 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:24:08.304352 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b94197f9-8c0d-4ff2-80cb-87be09043bab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:08.305234 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b94197f9-8c0d-4ff2-80cb-87be09043bab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:08.314954 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b94197f9-8c0d-4ff2-80cb-87be09043bab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:08.315439 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b94197f9-8c0d-4ff2-80cb-87be09043bab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:08.315891 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b94197f9-8c0d-4ff2-80cb-87be09043bab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:08.322244 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b94197f9-8c0d-4ff2-80cb-87be09043bab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:08.322968 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b94197f9-8c0d-4ff2-80cb-87be09043bab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:08.323425 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b94197f9-8c0d-4ff2-80cb-87be09043bab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:08.591022 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b94197f9-8c0d-4ff2-80cb-87be09043bab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:08.621016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b94197f9-8c0d-4ff2-80cb-87be09043bab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:08.624992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b94197f9-8c0d-4ff2-80cb-87be09043bab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:08.627059 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b94197f9-8c0d-4ff2-80cb-87be09043bab tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1739 microversion: 2.20 time: 0.329034 Sep 05 12:24:08.627656 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 254/509] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:08 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1739 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:09.200941 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-fd40baa3-38ad-4863-80f0-c0f179fe9779 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:09.202576 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-fd40baa3-38ad-4863-80f0-c0f179fe9779 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:09.209943 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fd40baa3-38ad-4863-80f0-c0f179fe9779 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:09.210798 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fd40baa3-38ad-4863-80f0-c0f179fe9779 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:09.211389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fd40baa3-38ad-4863-80f0-c0f179fe9779 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:09.212177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fd40baa3-38ad-4863-80f0-c0f179fe9779 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:09.212720 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fd40baa3-38ad-4863-80f0-c0f179fe9779 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:09.213158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fd40baa3-38ad-4863-80f0-c0f179fe9779 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:09.403275 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-fd40baa3-38ad-4863-80f0-c0f179fe9779 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:09.413200 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-fd40baa3-38ad-4863-80f0-c0f179fe9779 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1318 microversion: 2.1 time: 0.217336 Sep 05 12:24:09.428141 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 256/510] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:09 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:24:09.657830 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c7ccdf90-2a1e-4d1a-bf0e-29d3d5200747 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:09.658440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c7ccdf90-2a1e-4d1a-bf0e-29d3d5200747 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:09.665902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c7ccdf90-2a1e-4d1a-bf0e-29d3d5200747 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:09.666384 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c7ccdf90-2a1e-4d1a-bf0e-29d3d5200747 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:09.666821 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c7ccdf90-2a1e-4d1a-bf0e-29d3d5200747 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:09.667550 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c7ccdf90-2a1e-4d1a-bf0e-29d3d5200747 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:09.668199 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c7ccdf90-2a1e-4d1a-bf0e-29d3d5200747 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:09.668799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c7ccdf90-2a1e-4d1a-bf0e-29d3d5200747 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:09.824055 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c7ccdf90-2a1e-4d1a-bf0e-29d3d5200747 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:09.833827 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c7ccdf90-2a1e-4d1a-bf0e-29d3d5200747 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:09.835838 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c7ccdf90-2a1e-4d1a-bf0e-29d3d5200747 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:09.837805 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c7ccdf90-2a1e-4d1a-bf0e-29d3d5200747 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1739 microversion: 2.20 time: 0.183893 Sep 05 12:24:09.842258 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 255/511] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:09 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:24:10.253452 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-4d5b1441-267b-456d-b347-7ec6c77c4385 req-dd7b85ce-e5db-4ff8-bd4d-64860b432bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6911e31-cf61-4f60-a234-f90a7678e930", "name": "network-vif-plugged", "status": "completed", "tag": "490cb85a-153f-4bf1-a83d-4ca81c9e81a7"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:24:10.268923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-4d5b1441-267b-456d-b347-7ec6c77c4385 req-dd7b85ce-e5db-4ff8-bd4d-64860b432bd8 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:10.269452 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-4d5b1441-267b-456d-b347-7ec6c77c4385 req-dd7b85ce-e5db-4ff8-bd4d-64860b432bd8 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:10.271717 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-4d5b1441-267b-456d-b347-7ec6c77c4385 req-dd7b85ce-e5db-4ff8-bd4d-64860b432bd8 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:10.277247 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:10.287264 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-4d5b1441-267b-456d-b347-7ec6c77c4385 req-dd7b85ce-e5db-4ff8-bd4d-64860b432bd8 service nova] Creating event network-vif-plugged:490cb85a-153f-4bf1-a83d-4ca81c9e81a7 for instance f6911e31-cf61-4f60-a234-f90a7678e930 on hv-cinder-85518 Sep 05 12:24:10.295114 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-4d5b1441-267b-456d-b347-7ec6c77c4385 req-dd7b85ce-e5db-4ff8-bd4d-64860b432bd8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045095 Sep 05 12:24:10.296093 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 257/512] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:24:10.438835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c1ca034c-57e1-4afd-bf50-7d28a6b94777 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:10.439932 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c1ca034c-57e1-4afd-bf50-7d28a6b94777 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:10.451887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c1ca034c-57e1-4afd-bf50-7d28a6b94777 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:10.451887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c1ca034c-57e1-4afd-bf50-7d28a6b94777 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:10.452408 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c1ca034c-57e1-4afd-bf50-7d28a6b94777 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:10.453401 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c1ca034c-57e1-4afd-bf50-7d28a6b94777 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:10.453577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c1ca034c-57e1-4afd-bf50-7d28a6b94777 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:10.454020 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c1ca034c-57e1-4afd-bf50-7d28a6b94777 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:10.670526 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c1ca034c-57e1-4afd-bf50-7d28a6b94777 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:10.679402 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c1ca034c-57e1-4afd-bf50-7d28a6b94777 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1318 microversion: 2.1 time: 0.244221 Sep 05 12:24:10.689561 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 256/513] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:10 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:24:10.871477 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1da43501-41c3-4a09-9c4f-134ef7f8c33e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:10.873184 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1da43501-41c3-4a09-9c4f-134ef7f8c33e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:10.887001 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1da43501-41c3-4a09-9c4f-134ef7f8c33e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:10.887910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1da43501-41c3-4a09-9c4f-134ef7f8c33e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:10.888677 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1da43501-41c3-4a09-9c4f-134ef7f8c33e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:10.890095 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1da43501-41c3-4a09-9c4f-134ef7f8c33e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:10.891661 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1da43501-41c3-4a09-9c4f-134ef7f8c33e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:10.892443 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1da43501-41c3-4a09-9c4f-134ef7f8c33e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:11.081644 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1da43501-41c3-4a09-9c4f-134ef7f8c33e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:11.122900 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1da43501-41c3-4a09-9c4f-134ef7f8c33e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:11.124381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1da43501-41c3-4a09-9c4f-134ef7f8c33e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:11.125633 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1da43501-41c3-4a09-9c4f-134ef7f8c33e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1739 microversion: 2.20 time: 0.263931 Sep 05 12:24:11.126195 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 258/514] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:10 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:11.702946 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-58108ca9-c793-4609-bf86-5b1f90a406c9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:11.704303 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-58108ca9-c793-4609-bf86-5b1f90a406c9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:11.711130 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-58108ca9-c793-4609-bf86-5b1f90a406c9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:11.711961 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-58108ca9-c793-4609-bf86-5b1f90a406c9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:11.712401 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-58108ca9-c793-4609-bf86-5b1f90a406c9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:11.713135 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-58108ca9-c793-4609-bf86-5b1f90a406c9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:11.713596 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-58108ca9-c793-4609-bf86-5b1f90a406c9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:11.714031 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-58108ca9-c793-4609-bf86-5b1f90a406c9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:11.867441 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-58108ca9-c793-4609-bf86-5b1f90a406c9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:11.875859 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-58108ca9-c793-4609-bf86-5b1f90a406c9 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1318 microversion: 2.1 time: 0.177038 Sep 05 12:24:11.876469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 257/515] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:11 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:24:12.152125 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d382d73f-19c9-4c65-8417-16ed11ab95ce tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:12.152742 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d382d73f-19c9-4c65-8417-16ed11ab95ce tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:12.160049 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d382d73f-19c9-4c65-8417-16ed11ab95ce tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:12.160536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d382d73f-19c9-4c65-8417-16ed11ab95ce tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:12.160971 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d382d73f-19c9-4c65-8417-16ed11ab95ce tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:12.161672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d382d73f-19c9-4c65-8417-16ed11ab95ce tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:12.162127 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d382d73f-19c9-4c65-8417-16ed11ab95ce tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:12.162545 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d382d73f-19c9-4c65-8417-16ed11ab95ce tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:12.313341 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d382d73f-19c9-4c65-8417-16ed11ab95ce tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:12.322462 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d382d73f-19c9-4c65-8417-16ed11ab95ce tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:12.323960 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d382d73f-19c9-4c65-8417-16ed11ab95ce tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:12.325190 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d382d73f-19c9-4c65-8417-16ed11ab95ce tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1739 microversion: 2.20 time: 0.177917 Sep 05 12:24:12.325759 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 259/516] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:12 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:12.899066 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-92257004-e1e7-426f-a90a-26b3530fa337 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:12.899838 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-92257004-e1e7-426f-a90a-26b3530fa337 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:12.906923 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92257004-e1e7-426f-a90a-26b3530fa337 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:12.907416 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92257004-e1e7-426f-a90a-26b3530fa337 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:12.907888 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92257004-e1e7-426f-a90a-26b3530fa337 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:12.908601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92257004-e1e7-426f-a90a-26b3530fa337 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:12.909058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92257004-e1e7-426f-a90a-26b3530fa337 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:12.909489 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-92257004-e1e7-426f-a90a-26b3530fa337 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:13.073322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-92257004-e1e7-426f-a90a-26b3530fa337 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:13.081604 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-92257004-e1e7-426f-a90a-26b3530fa337 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1318 microversion: 2.1 time: 0.186383 Sep 05 12:24:13.082196 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 258/517] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:12 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:24:13.357851 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-6d20056d-abf1-4a87-b024-d2d99cbb0903 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:13.358469 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-6d20056d-abf1-4a87-b024-d2d99cbb0903 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:13.365202 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6d20056d-abf1-4a87-b024-d2d99cbb0903 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:13.365689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6d20056d-abf1-4a87-b024-d2d99cbb0903 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:13.366131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6d20056d-abf1-4a87-b024-d2d99cbb0903 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:13.366834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6d20056d-abf1-4a87-b024-d2d99cbb0903 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:13.367291 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6d20056d-abf1-4a87-b024-d2d99cbb0903 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:13.372199 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6d20056d-abf1-4a87-b024-d2d99cbb0903 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:13.510092 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6d20056d-abf1-4a87-b024-d2d99cbb0903 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:13.518927 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6d20056d-abf1-4a87-b024-d2d99cbb0903 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:13.520440 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6d20056d-abf1-4a87-b024-d2d99cbb0903 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:13.521717 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-6d20056d-abf1-4a87-b024-d2d99cbb0903 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1721 microversion: 2.20 time: 0.168233 Sep 05 12:24:13.522373 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 260/518] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:13 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:24:14.106601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-69ba3252-db22-45da-94ca-3e334c03b1b8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:14.107269 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-69ba3252-db22-45da-94ca-3e334c03b1b8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:14.114572 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-69ba3252-db22-45da-94ca-3e334c03b1b8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:14.115066 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-69ba3252-db22-45da-94ca-3e334c03b1b8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:14.115508 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-69ba3252-db22-45da-94ca-3e334c03b1b8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:14.116258 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-69ba3252-db22-45da-94ca-3e334c03b1b8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:14.116728 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-69ba3252-db22-45da-94ca-3e334c03b1b8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:14.117159 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-69ba3252-db22-45da-94ca-3e334c03b1b8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:14.339582 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-69ba3252-db22-45da-94ca-3e334c03b1b8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:14.349270 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-69ba3252-db22-45da-94ca-3e334c03b1b8 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1507 microversion: 2.1 time: 0.247311 Sep 05 12:24:14.350056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 259/519] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:14 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:24:14.373233 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7bb3f0a8-2aea-4b70-9eb3-a695329bf592 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85f80aaf-55d7-486a-8db4-73caf231b5f6", "device": "/dev/sdb"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:24:14.376218 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7bb3f0a8-2aea-4b70-9eb3-a695329bf592 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:14.382840 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7bb3f0a8-2aea-4b70-9eb3-a695329bf592 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:14.383424 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7bb3f0a8-2aea-4b70-9eb3-a695329bf592 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:14.383902 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7bb3f0a8-2aea-4b70-9eb3-a695329bf592 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:14.384638 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7bb3f0a8-2aea-4b70-9eb3-a695329bf592 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:14.385102 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7bb3f0a8-2aea-4b70-9eb3-a695329bf592 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:14.385531 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7bb3f0a8-2aea-4b70-9eb3-a695329bf592 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:14.558158 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b139cd62-99b5-459d-acd9-015533b76385 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:14.561563 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b139cd62-99b5-459d-acd9-015533b76385 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:14.576086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b139cd62-99b5-459d-acd9-015533b76385 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:14.576864 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b139cd62-99b5-459d-acd9-015533b76385 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:14.578116 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b139cd62-99b5-459d-acd9-015533b76385 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:14.579054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b139cd62-99b5-459d-acd9-015533b76385 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:14.579707 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b139cd62-99b5-459d-acd9-015533b76385 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:14.580334 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b139cd62-99b5-459d-acd9-015533b76385 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:14.768393 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7bb3f0a8-2aea-4b70-9eb3-a695329bf592 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "POST /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398435 Sep 05 12:24:14.770209 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 261/520] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Sep 5 12:24:14 2022] POST /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:24:14.906006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b139cd62-99b5-459d-acd9-015533b76385 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:14.918041 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b139cd62-99b5-459d-acd9-015533b76385 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:14.919759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b139cd62-99b5-459d-acd9-015533b76385 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:14.921070 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b139cd62-99b5-459d-acd9-015533b76385 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1721 microversion: 2.20 time: 0.371432 Sep 05 12:24:14.922408 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 260/521] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:14 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1721 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:15.958347 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b499e0fa-a06c-4242-9814-f7ea7a13a12f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:15.959300 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b499e0fa-a06c-4242-9814-f7ea7a13a12f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:15.966961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b499e0fa-a06c-4242-9814-f7ea7a13a12f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:15.967433 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b499e0fa-a06c-4242-9814-f7ea7a13a12f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:15.967898 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b499e0fa-a06c-4242-9814-f7ea7a13a12f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:15.968606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b499e0fa-a06c-4242-9814-f7ea7a13a12f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:15.969070 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b499e0fa-a06c-4242-9814-f7ea7a13a12f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:15.969501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b499e0fa-a06c-4242-9814-f7ea7a13a12f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:16.117262 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b499e0fa-a06c-4242-9814-f7ea7a13a12f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:16.127149 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b499e0fa-a06c-4242-9814-f7ea7a13a12f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:16.128617 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b499e0fa-a06c-4242-9814-f7ea7a13a12f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:16.129813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b499e0fa-a06c-4242-9814-f7ea7a13a12f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1721 microversion: 2.20 time: 0.175787 Sep 05 12:24:16.130619 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 262/522] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:15 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:16.174541 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-57ba3f4d-d272-4ce0-ba1c-d589d821b7a1 req-33ff978b-49a1-4887-8193-3ad39c6016ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78cd9ae3-2a60-4905-a291-30169e41c86c", "name": "network-vif-unplugged", "status": "completed", "tag": "6a5ea4f2-8220-4378-84c2-dc1b033a8dd0"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:24:16.187824 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-57ba3f4d-d272-4ce0-ba1c-d589d821b7a1 req-33ff978b-49a1-4887-8193-3ad39c6016ed service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:16.188343 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-57ba3f4d-d272-4ce0-ba1c-d589d821b7a1 req-33ff978b-49a1-4887-8193-3ad39c6016ed service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:16.189084 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-57ba3f4d-d272-4ce0-ba1c-d589d821b7a1 req-33ff978b-49a1-4887-8193-3ad39c6016ed service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:16.201687 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-57ba3f4d-d272-4ce0-ba1c-d589d821b7a1 req-33ff978b-49a1-4887-8193-3ad39c6016ed service nova] Creating event network-vif-unplugged:6a5ea4f2-8220-4378-84c2-dc1b033a8dd0 for instance 78cd9ae3-2a60-4905-a291-30169e41c86c on hv-cinder-85518 Sep 05 12:24:16.207248 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-57ba3f4d-d272-4ce0-ba1c-d589d821b7a1 req-33ff978b-49a1-4887-8193-3ad39c6016ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036485 Sep 05 12:24:16.207888 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 261/523] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:24:17.156050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f2020b34-1bc6-4677-b9cf-ca835bc89e12 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:17.156660 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f2020b34-1bc6-4677-b9cf-ca835bc89e12 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:17.163313 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2020b34-1bc6-4677-b9cf-ca835bc89e12 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:17.163837 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2020b34-1bc6-4677-b9cf-ca835bc89e12 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:17.164280 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2020b34-1bc6-4677-b9cf-ca835bc89e12 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:17.165704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2020b34-1bc6-4677-b9cf-ca835bc89e12 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:17.166161 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2020b34-1bc6-4677-b9cf-ca835bc89e12 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:17.166594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f2020b34-1bc6-4677-b9cf-ca835bc89e12 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:17.307929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f2020b34-1bc6-4677-b9cf-ca835bc89e12 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:17.317286 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f2020b34-1bc6-4677-b9cf-ca835bc89e12 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:17.318735 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f2020b34-1bc6-4677-b9cf-ca835bc89e12 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:17.320131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f2020b34-1bc6-4677-b9cf-ca835bc89e12 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1721 microversion: 2.20 time: 0.167960 Sep 05 12:24:17.320704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 263/524] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:17 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:18.347005 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2d9f2529-94df-4d87-b5e5-05bb6c3cf81b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:18.347777 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2d9f2529-94df-4d87-b5e5-05bb6c3cf81b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:18.354962 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d9f2529-94df-4d87-b5e5-05bb6c3cf81b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:18.355458 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d9f2529-94df-4d87-b5e5-05bb6c3cf81b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:18.355930 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d9f2529-94df-4d87-b5e5-05bb6c3cf81b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:18.356635 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d9f2529-94df-4d87-b5e5-05bb6c3cf81b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:18.357093 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d9f2529-94df-4d87-b5e5-05bb6c3cf81b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:18.357521 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d9f2529-94df-4d87-b5e5-05bb6c3cf81b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:18.509989 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2d9f2529-94df-4d87-b5e5-05bb6c3cf81b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:18.518549 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2d9f2529-94df-4d87-b5e5-05bb6c3cf81b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:18.520037 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2d9f2529-94df-4d87-b5e5-05bb6c3cf81b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:18.521184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2d9f2529-94df-4d87-b5e5-05bb6c3cf81b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1664 microversion: 2.20 time: 0.178579 Sep 05 12:24:18.521733 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 262/525] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:18 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1664 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:18.548447 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-717f237a-8817-470a-9b21-10d1000cff2a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5be5f278-c5f2-4f11-87a5-d1412749ed40"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:24:18.552395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-717f237a-8817-470a-9b21-10d1000cff2a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:18.564080 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-717f237a-8817-470a-9b21-10d1000cff2a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:18.564942 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-717f237a-8817-470a-9b21-10d1000cff2a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:18.565751 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-717f237a-8817-470a-9b21-10d1000cff2a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:18.567043 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-717f237a-8817-470a-9b21-10d1000cff2a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:18.567941 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-717f237a-8817-470a-9b21-10d1000cff2a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:18.568749 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-717f237a-8817-470a-9b21-10d1000cff2a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:18.924061 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-717f237a-8817-470a-9b21-10d1000cff2a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "POST /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.380715 Sep 05 12:24:18.924706 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 264/526] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Sep 5 12:24:18 2022] POST /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/os-volume_attachments => generated 188 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:24:19.076760 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b11d4fa4-19b0-4bd0-a771-c7f257e0122c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:24:19.076760 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b11d4fa4-19b0-4bd0-a771-c7f257e0122c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:19.078935 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b11d4fa4-19b0-4bd0-a771-c7f257e0122c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:19.079418 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b11d4fa4-19b0-4bd0-a771-c7f257e0122c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:19.079890 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b11d4fa4-19b0-4bd0-a771-c7f257e0122c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:19.080585 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b11d4fa4-19b0-4bd0-a771-c7f257e0122c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:19.081031 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b11d4fa4-19b0-4bd0-a771-c7f257e0122c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:19.081454 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b11d4fa4-19b0-4bd0-a771-c7f257e0122c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:19.178733 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b11d4fa4-19b0-4bd0-a771-c7f257e0122c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120535) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 05 12:24:19.251756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b11d4fa4-19b0-4bd0-a771-c7f257e0122c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "POST /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/action" status: 202 len: 0 microversion: 2.20 time: 0.183297 Sep 05 12:24:19.252384 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 263/527] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Sep 5 12:24:19 2022] POST /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:24:19.261107 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-067754b4-be04-4595-b50e-17e4df84a47c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:19.261810 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-067754b4-be04-4595-b50e-17e4df84a47c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:19.268826 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-067754b4-be04-4595-b50e-17e4df84a47c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:19.269245 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-067754b4-be04-4595-b50e-17e4df84a47c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:19.269677 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-067754b4-be04-4595-b50e-17e4df84a47c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:19.270384 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-067754b4-be04-4595-b50e-17e4df84a47c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:19.270838 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-067754b4-be04-4595-b50e-17e4df84a47c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:19.271470 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-067754b4-be04-4595-b50e-17e4df84a47c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:19.427629 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-067754b4-be04-4595-b50e-17e4df84a47c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:19.445757 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-067754b4-be04-4595-b50e-17e4df84a47c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:19.448692 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-067754b4-be04-4595-b50e-17e4df84a47c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:19.450794 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-067754b4-be04-4595-b50e-17e4df84a47c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1750 microversion: 2.20 time: 0.193402 Sep 05 12:24:19.451482 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 265/528] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:19 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1750 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:24:20.480304 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b922d262-f58d-427e-a678-83090e3d5503 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:20.480943 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b922d262-f58d-427e-a678-83090e3d5503 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:20.487442 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b922d262-f58d-427e-a678-83090e3d5503 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:20.487976 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b922d262-f58d-427e-a678-83090e3d5503 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:20.488418 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b922d262-f58d-427e-a678-83090e3d5503 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:20.489131 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b922d262-f58d-427e-a678-83090e3d5503 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:20.489584 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b922d262-f58d-427e-a678-83090e3d5503 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:20.490006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b922d262-f58d-427e-a678-83090e3d5503 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:20.667230 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b922d262-f58d-427e-a678-83090e3d5503 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:20.683412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b922d262-f58d-427e-a678-83090e3d5503 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:20.686318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b922d262-f58d-427e-a678-83090e3d5503 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:20.688290 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b922d262-f58d-427e-a678-83090e3d5503 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1750 microversion: 2.20 time: 0.212980 Sep 05 12:24:20.689323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 264/529] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:20 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1750 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:21.729474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9413d868-7883-422d-9107-8f01ee1b18da tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:21.730201 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9413d868-7883-422d-9107-8f01ee1b18da tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:21.737242 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9413d868-7883-422d-9107-8f01ee1b18da tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:21.737851 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9413d868-7883-422d-9107-8f01ee1b18da tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:21.738298 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9413d868-7883-422d-9107-8f01ee1b18da tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:21.739106 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9413d868-7883-422d-9107-8f01ee1b18da tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:21.739658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9413d868-7883-422d-9107-8f01ee1b18da tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:21.740088 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9413d868-7883-422d-9107-8f01ee1b18da tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:21.892605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9413d868-7883-422d-9107-8f01ee1b18da tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:21.902692 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9413d868-7883-422d-9107-8f01ee1b18da tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:21.904263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9413d868-7883-422d-9107-8f01ee1b18da tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:21.905473 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9413d868-7883-422d-9107-8f01ee1b18da tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1752 microversion: 2.20 time: 0.180619 Sep 05 12:24:21.906041 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 266/530] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:21 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:22.933622 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0799b4a5-6c24-46ba-a98d-9f0e24900c35 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:22.934024 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0799b4a5-6c24-46ba-a98d-9f0e24900c35 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:22.940614 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0799b4a5-6c24-46ba-a98d-9f0e24900c35 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:22.941101 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0799b4a5-6c24-46ba-a98d-9f0e24900c35 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:22.941535 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0799b4a5-6c24-46ba-a98d-9f0e24900c35 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:22.942256 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0799b4a5-6c24-46ba-a98d-9f0e24900c35 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:22.942703 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0799b4a5-6c24-46ba-a98d-9f0e24900c35 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:22.943130 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0799b4a5-6c24-46ba-a98d-9f0e24900c35 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:22.946072 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:23.094419 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0799b4a5-6c24-46ba-a98d-9f0e24900c35 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:23.104940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0799b4a5-6c24-46ba-a98d-9f0e24900c35 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:23.106396 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0799b4a5-6c24-46ba-a98d-9f0e24900c35 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:23.107607 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0799b4a5-6c24-46ba-a98d-9f0e24900c35 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1752 microversion: 2.20 time: 0.179080 Sep 05 12:24:23.108175 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 265/531] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:22 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:24.135077 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8371ab5b-e325-484c-a60f-d7ba7c2c2c02 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:24.135893 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-8371ab5b-e325-484c-a60f-d7ba7c2c2c02 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:24.143416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8371ab5b-e325-484c-a60f-d7ba7c2c2c02 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:24.143970 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8371ab5b-e325-484c-a60f-d7ba7c2c2c02 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:24.144431 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8371ab5b-e325-484c-a60f-d7ba7c2c2c02 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:24.145164 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8371ab5b-e325-484c-a60f-d7ba7c2c2c02 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:24.145646 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8371ab5b-e325-484c-a60f-d7ba7c2c2c02 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:24.146072 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8371ab5b-e325-484c-a60f-d7ba7c2c2c02 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:24.297975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8371ab5b-e325-484c-a60f-d7ba7c2c2c02 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:24.313636 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8371ab5b-e325-484c-a60f-d7ba7c2c2c02 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:24.316526 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8371ab5b-e325-484c-a60f-d7ba7c2c2c02 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:24.318819 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8371ab5b-e325-484c-a60f-d7ba7c2c2c02 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1752 microversion: 2.20 time: 0.188927 Sep 05 12:24:24.331558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 267/532] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:24 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:25.353119 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-3efdbfe9-3dea-4bcf-b8c3-f7561965df8f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:25.353807 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3efdbfe9-3dea-4bcf-b8c3-f7561965df8f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:25.360548 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3efdbfe9-3dea-4bcf-b8c3-f7561965df8f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:25.361030 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3efdbfe9-3dea-4bcf-b8c3-f7561965df8f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:25.361459 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3efdbfe9-3dea-4bcf-b8c3-f7561965df8f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:25.362163 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3efdbfe9-3dea-4bcf-b8c3-f7561965df8f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:25.362607 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3efdbfe9-3dea-4bcf-b8c3-f7561965df8f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:25.363024 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3efdbfe9-3dea-4bcf-b8c3-f7561965df8f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:25.511180 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-3efdbfe9-3dea-4bcf-b8c3-f7561965df8f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:25.520584 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-3efdbfe9-3dea-4bcf-b8c3-f7561965df8f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:25.521505 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-3efdbfe9-3dea-4bcf-b8c3-f7561965df8f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:25.522677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-3efdbfe9-3dea-4bcf-b8c3-f7561965df8f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.173518 Sep 05 12:24:25.523237 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 266/533] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:25 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:26.547544 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f9ab80a8-67fb-497a-9fd5-6fe2c3f56b30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:26.548144 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f9ab80a8-67fb-497a-9fd5-6fe2c3f56b30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:26.555867 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9ab80a8-67fb-497a-9fd5-6fe2c3f56b30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:26.556357 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9ab80a8-67fb-497a-9fd5-6fe2c3f56b30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:26.556829 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9ab80a8-67fb-497a-9fd5-6fe2c3f56b30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:26.557536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9ab80a8-67fb-497a-9fd5-6fe2c3f56b30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:26.557992 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9ab80a8-67fb-497a-9fd5-6fe2c3f56b30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:26.558419 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9ab80a8-67fb-497a-9fd5-6fe2c3f56b30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:26.694427 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f9ab80a8-67fb-497a-9fd5-6fe2c3f56b30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:26.703918 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f9ab80a8-67fb-497a-9fd5-6fe2c3f56b30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:26.705347 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f9ab80a8-67fb-497a-9fd5-6fe2c3f56b30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:26.706522 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f9ab80a8-67fb-497a-9fd5-6fe2c3f56b30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.162953 Sep 05 12:24:26.707084 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 268/534] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:26 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:27.732877 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-878cc2ce-639d-4a75-a92d-4bb51931b1d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:27.733447 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-878cc2ce-639d-4a75-a92d-4bb51931b1d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:27.735986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:27.741558 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-878cc2ce-639d-4a75-a92d-4bb51931b1d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:27.742030 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-878cc2ce-639d-4a75-a92d-4bb51931b1d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:27.742497 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-878cc2ce-639d-4a75-a92d-4bb51931b1d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:27.743185 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-878cc2ce-639d-4a75-a92d-4bb51931b1d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:27.743650 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-878cc2ce-639d-4a75-a92d-4bb51931b1d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:27.744064 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-878cc2ce-639d-4a75-a92d-4bb51931b1d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:27.882668 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-878cc2ce-639d-4a75-a92d-4bb51931b1d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:27.891754 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-878cc2ce-639d-4a75-a92d-4bb51931b1d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:27.893330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-878cc2ce-639d-4a75-a92d-4bb51931b1d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:27.894631 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-878cc2ce-639d-4a75-a92d-4bb51931b1d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.165628 Sep 05 12:24:27.895084 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 267/535] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:27 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:28.921265 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3815d590-6360-4be2-be9d-5c91d4374ece tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:28.921871 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-3815d590-6360-4be2-be9d-5c91d4374ece tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:28.928583 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3815d590-6360-4be2-be9d-5c91d4374ece tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:28.929079 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3815d590-6360-4be2-be9d-5c91d4374ece tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:28.929513 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3815d590-6360-4be2-be9d-5c91d4374ece tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:28.930851 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3815d590-6360-4be2-be9d-5c91d4374ece tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:28.931310 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3815d590-6360-4be2-be9d-5c91d4374ece tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:28.931763 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3815d590-6360-4be2-be9d-5c91d4374ece tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:29.068719 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-3815d590-6360-4be2-be9d-5c91d4374ece tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:29.077936 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-3815d590-6360-4be2-be9d-5c91d4374ece tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:29.079387 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-3815d590-6360-4be2-be9d-5c91d4374ece tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:29.080578 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-3815d590-6360-4be2-be9d-5c91d4374ece tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.163350 Sep 05 12:24:29.081141 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 269/536] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:28 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:30.106924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-3c621a5e-d9fb-4e0c-8295-482f43be99d4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:30.107800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3c621a5e-d9fb-4e0c-8295-482f43be99d4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:30.114868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3c621a5e-d9fb-4e0c-8295-482f43be99d4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:30.115358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3c621a5e-d9fb-4e0c-8295-482f43be99d4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:30.115832 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3c621a5e-d9fb-4e0c-8295-482f43be99d4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:30.116649 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3c621a5e-d9fb-4e0c-8295-482f43be99d4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:30.117146 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3c621a5e-d9fb-4e0c-8295-482f43be99d4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:30.118029 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3c621a5e-d9fb-4e0c-8295-482f43be99d4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:30.333389 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-3c621a5e-d9fb-4e0c-8295-482f43be99d4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:30.347739 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-3c621a5e-d9fb-4e0c-8295-482f43be99d4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:30.350290 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-3c621a5e-d9fb-4e0c-8295-482f43be99d4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:30.352287 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-3c621a5e-d9fb-4e0c-8295-482f43be99d4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.249094 Sep 05 12:24:30.353007 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 268/537] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:30 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:31.378912 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-eed27ea9-3898-4cbf-8d98-320956fb3132 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:31.380170 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-eed27ea9-3898-4cbf-8d98-320956fb3132 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:31.382872 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=46 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:31.388973 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eed27ea9-3898-4cbf-8d98-320956fb3132 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:31.389510 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eed27ea9-3898-4cbf-8d98-320956fb3132 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:31.389902 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eed27ea9-3898-4cbf-8d98-320956fb3132 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:31.390642 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eed27ea9-3898-4cbf-8d98-320956fb3132 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:31.391103 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eed27ea9-3898-4cbf-8d98-320956fb3132 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:31.391561 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eed27ea9-3898-4cbf-8d98-320956fb3132 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:31.411893 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:31.530066 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-eed27ea9-3898-4cbf-8d98-320956fb3132 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:31.538592 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-eed27ea9-3898-4cbf-8d98-320956fb3132 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:31.540135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-eed27ea9-3898-4cbf-8d98-320956fb3132 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:31.541298 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-eed27ea9-3898-4cbf-8d98-320956fb3132 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.166774 Sep 05 12:24:31.541854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 270/538] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:31 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:32.572021 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a6525c34-54b1-449f-bf84-eda4f24e3156 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:32.573164 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a6525c34-54b1-449f-bf84-eda4f24e3156 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:32.581287 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a6525c34-54b1-449f-bf84-eda4f24e3156 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:32.581776 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a6525c34-54b1-449f-bf84-eda4f24e3156 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:32.582214 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a6525c34-54b1-449f-bf84-eda4f24e3156 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:32.582914 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a6525c34-54b1-449f-bf84-eda4f24e3156 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:32.583371 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a6525c34-54b1-449f-bf84-eda4f24e3156 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:32.583828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a6525c34-54b1-449f-bf84-eda4f24e3156 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:32.720139 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a6525c34-54b1-449f-bf84-eda4f24e3156 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:32.729920 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a6525c34-54b1-449f-bf84-eda4f24e3156 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:32.731367 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a6525c34-54b1-449f-bf84-eda4f24e3156 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:32.732612 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a6525c34-54b1-449f-bf84-eda4f24e3156 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.168504 Sep 05 12:24:32.733572 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 269/539] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:32 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:33.757353 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-80473b27-cb9d-4056-bdf9-715b2289c1e7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:33.757964 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-80473b27-cb9d-4056-bdf9-715b2289c1e7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:33.764501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-80473b27-cb9d-4056-bdf9-715b2289c1e7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:33.764988 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-80473b27-cb9d-4056-bdf9-715b2289c1e7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:33.765426 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-80473b27-cb9d-4056-bdf9-715b2289c1e7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:33.766124 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-80473b27-cb9d-4056-bdf9-715b2289c1e7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:33.766575 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-80473b27-cb9d-4056-bdf9-715b2289c1e7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:33.767002 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-80473b27-cb9d-4056-bdf9-715b2289c1e7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:33.905937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-80473b27-cb9d-4056-bdf9-715b2289c1e7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:33.915419 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-80473b27-cb9d-4056-bdf9-715b2289c1e7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:33.916897 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-80473b27-cb9d-4056-bdf9-715b2289c1e7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:33.918056 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-80473b27-cb9d-4056-bdf9-715b2289c1e7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.164636 Sep 05 12:24:33.918614 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 271/540] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:33 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:24:34.944237 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-185bf575-fb9f-4e7e-ae06-d40f5b1feaad tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:34.944864 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-185bf575-fb9f-4e7e-ae06-d40f5b1feaad tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:34.954036 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-185bf575-fb9f-4e7e-ae06-d40f5b1feaad tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:34.954850 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-185bf575-fb9f-4e7e-ae06-d40f5b1feaad tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:34.955540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-185bf575-fb9f-4e7e-ae06-d40f5b1feaad tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:34.956639 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-185bf575-fb9f-4e7e-ae06-d40f5b1feaad tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:34.957354 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-185bf575-fb9f-4e7e-ae06-d40f5b1feaad tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:34.958023 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-185bf575-fb9f-4e7e-ae06-d40f5b1feaad tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:35.096936 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-185bf575-fb9f-4e7e-ae06-d40f5b1feaad tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:35.106853 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-185bf575-fb9f-4e7e-ae06-d40f5b1feaad tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:35.108338 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-185bf575-fb9f-4e7e-ae06-d40f5b1feaad tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:35.109504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-185bf575-fb9f-4e7e-ae06-d40f5b1feaad tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.169913 Sep 05 12:24:35.110066 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 270/541] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:34 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:36.135802 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c6e0657b-c4ca-41d7-8a27-471639d5d0bb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:36.136522 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c6e0657b-c4ca-41d7-8a27-471639d5d0bb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:36.142912 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6e0657b-c4ca-41d7-8a27-471639d5d0bb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:36.143388 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6e0657b-c4ca-41d7-8a27-471639d5d0bb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:36.143851 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6e0657b-c4ca-41d7-8a27-471639d5d0bb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:36.144554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6e0657b-c4ca-41d7-8a27-471639d5d0bb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:36.145015 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6e0657b-c4ca-41d7-8a27-471639d5d0bb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:36.145429 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6e0657b-c4ca-41d7-8a27-471639d5d0bb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:36.287426 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c6e0657b-c4ca-41d7-8a27-471639d5d0bb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:36.304691 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c6e0657b-c4ca-41d7-8a27-471639d5d0bb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:36.308515 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c6e0657b-c4ca-41d7-8a27-471639d5d0bb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:36.310538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c6e0657b-c4ca-41d7-8a27-471639d5d0bb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.179266 Sep 05 12:24:36.311559 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 272/542] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:36 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:37.337295 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9074c68e-3525-4601-b733-282ca1d553ee tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:37.337903 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-9074c68e-3525-4601-b733-282ca1d553ee tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:37.344712 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9074c68e-3525-4601-b733-282ca1d553ee tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:37.345346 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9074c68e-3525-4601-b733-282ca1d553ee tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:37.345843 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9074c68e-3525-4601-b733-282ca1d553ee tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:37.346621 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9074c68e-3525-4601-b733-282ca1d553ee tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:37.347077 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9074c68e-3525-4601-b733-282ca1d553ee tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:37.347703 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9074c68e-3525-4601-b733-282ca1d553ee tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:37.495938 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-9074c68e-3525-4601-b733-282ca1d553ee tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:37.504939 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-9074c68e-3525-4601-b733-282ca1d553ee tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:37.506374 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-9074c68e-3525-4601-b733-282ca1d553ee tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:37.507538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9074c68e-3525-4601-b733-282ca1d553ee tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.174755 Sep 05 12:24:37.508712 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 271/543] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:37 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:38.533734 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-564f7791-5b00-4e30-9cf1-aa6edbf97946 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:38.534383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-564f7791-5b00-4e30-9cf1-aa6edbf97946 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:38.541063 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-564f7791-5b00-4e30-9cf1-aa6edbf97946 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:38.541547 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-564f7791-5b00-4e30-9cf1-aa6edbf97946 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:38.541991 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-564f7791-5b00-4e30-9cf1-aa6edbf97946 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:38.542692 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-564f7791-5b00-4e30-9cf1-aa6edbf97946 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:38.543153 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-564f7791-5b00-4e30-9cf1-aa6edbf97946 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:38.543607 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-564f7791-5b00-4e30-9cf1-aa6edbf97946 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:38.912735 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-564f7791-5b00-4e30-9cf1-aa6edbf97946 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:38.923475 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-564f7791-5b00-4e30-9cf1-aa6edbf97946 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:38.925289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-564f7791-5b00-4e30-9cf1-aa6edbf97946 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:38.931419 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-564f7791-5b00-4e30-9cf1-aa6edbf97946 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.401550 Sep 05 12:24:38.932398 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 273/544] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:38 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:39.958645 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2367247d-4355-4c30-8406-fe20fd429dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:39.959326 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2367247d-4355-4c30-8406-fe20fd429dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:39.965933 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2367247d-4355-4c30-8406-fe20fd429dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:39.966419 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2367247d-4355-4c30-8406-fe20fd429dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:39.966852 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2367247d-4355-4c30-8406-fe20fd429dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:39.967566 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2367247d-4355-4c30-8406-fe20fd429dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:39.968021 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2367247d-4355-4c30-8406-fe20fd429dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:39.968453 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2367247d-4355-4c30-8406-fe20fd429dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:40.104411 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2367247d-4355-4c30-8406-fe20fd429dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:40.113585 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2367247d-4355-4c30-8406-fe20fd429dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:40.115137 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2367247d-4355-4c30-8406-fe20fd429dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:40.116374 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2367247d-4355-4c30-8406-fe20fd429dc1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.162025 Sep 05 12:24:40.116942 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 272/545] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:39 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:41.142364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-40f15b38-673e-478d-b188-439c8095848e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:41.142994 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-40f15b38-673e-478d-b188-439c8095848e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:41.149656 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-40f15b38-673e-478d-b188-439c8095848e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:41.150143 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-40f15b38-673e-478d-b188-439c8095848e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:41.150594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-40f15b38-673e-478d-b188-439c8095848e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:41.151904 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-40f15b38-673e-478d-b188-439c8095848e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:41.152452 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-40f15b38-673e-478d-b188-439c8095848e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:41.153043 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-40f15b38-673e-478d-b188-439c8095848e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:41.299826 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-40f15b38-673e-478d-b188-439c8095848e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:41.309224 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-40f15b38-673e-478d-b188-439c8095848e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:41.310673 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-40f15b38-673e-478d-b188-439c8095848e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:41.311847 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-40f15b38-673e-478d-b188-439c8095848e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.173374 Sep 05 12:24:41.312404 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 274/546] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:41 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:42.338199 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5a281eab-d615-4005-868e-47bf2b024afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:42.338869 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5a281eab-d615-4005-868e-47bf2b024afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:42.345850 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a281eab-d615-4005-868e-47bf2b024afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:42.346322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a281eab-d615-4005-868e-47bf2b024afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:42.346754 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a281eab-d615-4005-868e-47bf2b024afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:42.347462 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a281eab-d615-4005-868e-47bf2b024afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:42.347941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a281eab-d615-4005-868e-47bf2b024afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:42.348359 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a281eab-d615-4005-868e-47bf2b024afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:42.502408 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5a281eab-d615-4005-868e-47bf2b024afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:42.518999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5a281eab-d615-4005-868e-47bf2b024afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:42.520489 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5a281eab-d615-4005-868e-47bf2b024afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:42.521706 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5a281eab-d615-4005-868e-47bf2b024afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.188323 Sep 05 12:24:42.522267 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 273/547] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:42 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:43.551949 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e24d8a7f-5741-4e95-881e-a2f088caa1a4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:43.552990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e24d8a7f-5741-4e95-881e-a2f088caa1a4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:43.564672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e24d8a7f-5741-4e95-881e-a2f088caa1a4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:43.565570 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e24d8a7f-5741-4e95-881e-a2f088caa1a4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:43.566373 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e24d8a7f-5741-4e95-881e-a2f088caa1a4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:43.567696 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e24d8a7f-5741-4e95-881e-a2f088caa1a4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:43.568552 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e24d8a7f-5741-4e95-881e-a2f088caa1a4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:43.569364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e24d8a7f-5741-4e95-881e-a2f088caa1a4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:43.728159 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e24d8a7f-5741-4e95-881e-a2f088caa1a4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:43.737814 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e24d8a7f-5741-4e95-881e-a2f088caa1a4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:43.739548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e24d8a7f-5741-4e95-881e-a2f088caa1a4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:43.740859 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e24d8a7f-5741-4e95-881e-a2f088caa1a4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.195734 Sep 05 12:24:43.741432 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 275/548] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:43 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:44.767033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-56df28fb-1dbc-4a9e-ba4c-0d28fb0991b1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:44.767637 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-56df28fb-1dbc-4a9e-ba4c-0d28fb0991b1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:44.773660 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-56df28fb-1dbc-4a9e-ba4c-0d28fb0991b1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:44.774147 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-56df28fb-1dbc-4a9e-ba4c-0d28fb0991b1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:44.774578 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-56df28fb-1dbc-4a9e-ba4c-0d28fb0991b1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:44.775375 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-56df28fb-1dbc-4a9e-ba4c-0d28fb0991b1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:44.776579 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-56df28fb-1dbc-4a9e-ba4c-0d28fb0991b1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:44.777002 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-56df28fb-1dbc-4a9e-ba4c-0d28fb0991b1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:44.911028 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-56df28fb-1dbc-4a9e-ba4c-0d28fb0991b1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:44.920086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-56df28fb-1dbc-4a9e-ba4c-0d28fb0991b1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:44.921520 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-56df28fb-1dbc-4a9e-ba4c-0d28fb0991b1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:44.922692 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-56df28fb-1dbc-4a9e-ba4c-0d28fb0991b1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.159888 Sep 05 12:24:44.923249 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 274/549] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:44 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:45.949310 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f9718cc3-61d4-4ed5-892e-ff162b10601b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:45.949996 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f9718cc3-61d4-4ed5-892e-ff162b10601b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:45.957070 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9718cc3-61d4-4ed5-892e-ff162b10601b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:45.958052 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9718cc3-61d4-4ed5-892e-ff162b10601b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:45.958494 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9718cc3-61d4-4ed5-892e-ff162b10601b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:45.959246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9718cc3-61d4-4ed5-892e-ff162b10601b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:45.959761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9718cc3-61d4-4ed5-892e-ff162b10601b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:45.960421 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9718cc3-61d4-4ed5-892e-ff162b10601b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:46.106159 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f9718cc3-61d4-4ed5-892e-ff162b10601b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:46.120021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f9718cc3-61d4-4ed5-892e-ff162b10601b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:46.121549 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f9718cc3-61d4-4ed5-892e-ff162b10601b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:46.122923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f9718cc3-61d4-4ed5-892e-ff162b10601b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.178262 Sep 05 12:24:46.123543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 276/550] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:45 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:47.149967 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-06164021-4e7a-4128-9465-ab9d2534b257 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:47.151432 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-06164021-4e7a-4128-9465-ab9d2534b257 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:47.158374 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-06164021-4e7a-4128-9465-ab9d2534b257 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:47.159027 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-06164021-4e7a-4128-9465-ab9d2534b257 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:47.159466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-06164021-4e7a-4128-9465-ab9d2534b257 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:47.160386 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-06164021-4e7a-4128-9465-ab9d2534b257 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:47.160858 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-06164021-4e7a-4128-9465-ab9d2534b257 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:47.161423 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-06164021-4e7a-4128-9465-ab9d2534b257 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:47.305189 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-06164021-4e7a-4128-9465-ab9d2534b257 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:47.314562 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-06164021-4e7a-4128-9465-ab9d2534b257 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:47.315921 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-06164021-4e7a-4128-9465-ab9d2534b257 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:47.317083 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-06164021-4e7a-4128-9465-ab9d2534b257 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.171610 Sep 05 12:24:47.318921 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 275/551] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:47 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:24:48.343135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7be64bad-de41-4e98-850d-1e9e7955a6ed tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:48.343801 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7be64bad-de41-4e98-850d-1e9e7955a6ed tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:48.350597 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7be64bad-de41-4e98-850d-1e9e7955a6ed tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:48.351108 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7be64bad-de41-4e98-850d-1e9e7955a6ed tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:48.351593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7be64bad-de41-4e98-850d-1e9e7955a6ed tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:48.352481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7be64bad-de41-4e98-850d-1e9e7955a6ed tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:48.352868 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7be64bad-de41-4e98-850d-1e9e7955a6ed tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:48.353313 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7be64bad-de41-4e98-850d-1e9e7955a6ed tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:48.519053 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7be64bad-de41-4e98-850d-1e9e7955a6ed tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:48.534785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7be64bad-de41-4e98-850d-1e9e7955a6ed tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:48.536315 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7be64bad-de41-4e98-850d-1e9e7955a6ed tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:48.537536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7be64bad-de41-4e98-850d-1e9e7955a6ed tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.198385 Sep 05 12:24:48.538104 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 277/552] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:48 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:48.940136 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ed93f65e-3a61-4c5e-a2e3-b5ebdf7a31d4 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:48.940737 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ed93f65e-3a61-4c5e-a2e3-b5ebdf7a31d4 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:48.947794 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed93f65e-3a61-4c5e-a2e3-b5ebdf7a31d4 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:48.947794 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed93f65e-3a61-4c5e-a2e3-b5ebdf7a31d4 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:48.948216 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed93f65e-3a61-4c5e-a2e3-b5ebdf7a31d4 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:48.948927 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed93f65e-3a61-4c5e-a2e3-b5ebdf7a31d4 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:48.949574 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed93f65e-3a61-4c5e-a2e3-b5ebdf7a31d4 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:48.950003 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed93f65e-3a61-4c5e-a2e3-b5ebdf7a31d4 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:49.092456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-ed93f65e-3a61-4c5e-a2e3-b5ebdf7a31d4 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lazy-loading 'services' on Instance uuid f6911e31-cf61-4f60-a234-f90a7678e930 {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:24:49.235864 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ed93f65e-3a61-4c5e-a2e3-b5ebdf7a31d4 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930/os-volume_attachments/85f80aaf-55d7-486a-8db4-73caf231b5f6" status: 202 len: 0 microversion: 2.1 time: 0.299402 Sep 05 12:24:49.236518 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 276/553] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Sep 5 12:24:48 2022] DELETE /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930/os-volume_attachments/85f80aaf-55d7-486a-8db4-73caf231b5f6 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:24:49.564696 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e432caa9-e062-4a1f-9f95-026b50d4a9e1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:49.565310 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e432caa9-e062-4a1f-9f95-026b50d4a9e1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:49.571421 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e432caa9-e062-4a1f-9f95-026b50d4a9e1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:49.571950 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e432caa9-e062-4a1f-9f95-026b50d4a9e1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:49.572952 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e432caa9-e062-4a1f-9f95-026b50d4a9e1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:49.573665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e432caa9-e062-4a1f-9f95-026b50d4a9e1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:49.574119 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e432caa9-e062-4a1f-9f95-026b50d4a9e1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:49.574546 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e432caa9-e062-4a1f-9f95-026b50d4a9e1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:49.729996 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e432caa9-e062-4a1f-9f95-026b50d4a9e1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:49.739150 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e432caa9-e062-4a1f-9f95-026b50d4a9e1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:49.740687 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e432caa9-e062-4a1f-9f95-026b50d4a9e1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:49.741850 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e432caa9-e062-4a1f-9f95-026b50d4a9e1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.181611 Sep 05 12:24:49.743272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 278/554] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:49 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:50.769902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f4c0e537-d3c8-4b7c-a0f0-89aa8ecc7c4d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:50.770507 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f4c0e537-d3c8-4b7c-a0f0-89aa8ecc7c4d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:50.778581 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f4c0e537-d3c8-4b7c-a0f0-89aa8ecc7c4d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:50.779076 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f4c0e537-d3c8-4b7c-a0f0-89aa8ecc7c4d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:50.779513 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f4c0e537-d3c8-4b7c-a0f0-89aa8ecc7c4d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:50.780253 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f4c0e537-d3c8-4b7c-a0f0-89aa8ecc7c4d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:50.780711 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f4c0e537-d3c8-4b7c-a0f0-89aa8ecc7c4d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:50.781131 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f4c0e537-d3c8-4b7c-a0f0-89aa8ecc7c4d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:50.935412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f4c0e537-d3c8-4b7c-a0f0-89aa8ecc7c4d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:50.944627 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f4c0e537-d3c8-4b7c-a0f0-89aa8ecc7c4d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:50.946410 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f4c0e537-d3c8-4b7c-a0f0-89aa8ecc7c4d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:50.947304 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f4c0e537-d3c8-4b7c-a0f0-89aa8ecc7c4d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.182615 Sep 05 12:24:50.948618 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 277/555] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:50 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:51.973546 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ff446c49-1310-4b34-b004-22d989fb3db4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:51.974314 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ff446c49-1310-4b34-b004-22d989fb3db4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:51.980810 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ff446c49-1310-4b34-b004-22d989fb3db4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:51.981292 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ff446c49-1310-4b34-b004-22d989fb3db4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:51.981729 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ff446c49-1310-4b34-b004-22d989fb3db4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:51.982431 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ff446c49-1310-4b34-b004-22d989fb3db4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:51.982889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ff446c49-1310-4b34-b004-22d989fb3db4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:51.983321 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ff446c49-1310-4b34-b004-22d989fb3db4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:52.116987 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ff446c49-1310-4b34-b004-22d989fb3db4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:52.125847 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ff446c49-1310-4b34-b004-22d989fb3db4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:52.127288 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ff446c49-1310-4b34-b004-22d989fb3db4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:52.128479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ff446c49-1310-4b34-b004-22d989fb3db4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.158995 Sep 05 12:24:52.129031 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 279/556] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:51 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:53.155151 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-adcf2261-9ea6-4df9-a3ea-533a0c9dd652 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:53.155792 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-adcf2261-9ea6-4df9-a3ea-533a0c9dd652 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:53.162450 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-adcf2261-9ea6-4df9-a3ea-533a0c9dd652 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:53.162931 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-adcf2261-9ea6-4df9-a3ea-533a0c9dd652 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:53.163368 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-adcf2261-9ea6-4df9-a3ea-533a0c9dd652 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:53.164223 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-adcf2261-9ea6-4df9-a3ea-533a0c9dd652 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:53.164678 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-adcf2261-9ea6-4df9-a3ea-533a0c9dd652 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:53.165108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-adcf2261-9ea6-4df9-a3ea-533a0c9dd652 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:53.168577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:53.302358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-adcf2261-9ea6-4df9-a3ea-533a0c9dd652 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:53.311095 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-adcf2261-9ea6-4df9-a3ea-533a0c9dd652 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:53.312555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-adcf2261-9ea6-4df9-a3ea-533a0c9dd652 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:53.313698 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-adcf2261-9ea6-4df9-a3ea-533a0c9dd652 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.163304 Sep 05 12:24:53.314255 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 278/557] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:53 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:54.339867 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a2f03630-0180-4506-9482-a6521d928eac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:54.340420 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a2f03630-0180-4506-9482-a6521d928eac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:54.347344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2f03630-0180-4506-9482-a6521d928eac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:54.348018 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2f03630-0180-4506-9482-a6521d928eac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:54.348464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2f03630-0180-4506-9482-a6521d928eac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:54.349190 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2f03630-0180-4506-9482-a6521d928eac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:54.349650 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2f03630-0180-4506-9482-a6521d928eac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:54.350084 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2f03630-0180-4506-9482-a6521d928eac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:54.497432 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a2f03630-0180-4506-9482-a6521d928eac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:54.506730 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a2f03630-0180-4506-9482-a6521d928eac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:54.508223 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a2f03630-0180-4506-9482-a6521d928eac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:54.509396 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a2f03630-0180-4506-9482-a6521d928eac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.173778 Sep 05 12:24:54.510010 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 280/558] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:54 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:55.534984 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-29de5a4b-8b37-4096-b1dd-f7468f9ee3a6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:55.535649 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-29de5a4b-8b37-4096-b1dd-f7468f9ee3a6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:55.542224 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-29de5a4b-8b37-4096-b1dd-f7468f9ee3a6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:55.542700 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-29de5a4b-8b37-4096-b1dd-f7468f9ee3a6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:55.543131 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-29de5a4b-8b37-4096-b1dd-f7468f9ee3a6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:55.543852 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-29de5a4b-8b37-4096-b1dd-f7468f9ee3a6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:55.544301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-29de5a4b-8b37-4096-b1dd-f7468f9ee3a6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:55.544722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-29de5a4b-8b37-4096-b1dd-f7468f9ee3a6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:55.680701 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-29de5a4b-8b37-4096-b1dd-f7468f9ee3a6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:55.690509 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-29de5a4b-8b37-4096-b1dd-f7468f9ee3a6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:55.692061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-29de5a4b-8b37-4096-b1dd-f7468f9ee3a6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:55.693227 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-29de5a4b-8b37-4096-b1dd-f7468f9ee3a6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.162154 Sep 05 12:24:55.693783 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 279/559] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:55 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:56.722470 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9dd2b04d-f069-42ae-b2e3-0b96ce652bdd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:56.726089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9dd2b04d-f069-42ae-b2e3-0b96ce652bdd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:56.747314 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9dd2b04d-f069-42ae-b2e3-0b96ce652bdd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:56.747314 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9dd2b04d-f069-42ae-b2e3-0b96ce652bdd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:56.747314 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9dd2b04d-f069-42ae-b2e3-0b96ce652bdd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:56.747314 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9dd2b04d-f069-42ae-b2e3-0b96ce652bdd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:56.747715 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9dd2b04d-f069-42ae-b2e3-0b96ce652bdd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:56.747715 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9dd2b04d-f069-42ae-b2e3-0b96ce652bdd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:56.881984 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9dd2b04d-f069-42ae-b2e3-0b96ce652bdd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:56.892494 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9dd2b04d-f069-42ae-b2e3-0b96ce652bdd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:56.893887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9dd2b04d-f069-42ae-b2e3-0b96ce652bdd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:56.895076 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9dd2b04d-f069-42ae-b2e3-0b96ce652bdd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.179489 Sep 05 12:24:56.895981 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 281/560] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:56 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:57.824325 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-3faf73b8-ebd7-4310-830e-1f9a0a1dafe1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:57.824905 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3faf73b8-ebd7-4310-830e-1f9a0a1dafe1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:57.827216 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=26 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:57.832988 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3faf73b8-ebd7-4310-830e-1f9a0a1dafe1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:57.833471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3faf73b8-ebd7-4310-830e-1f9a0a1dafe1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:57.834191 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3faf73b8-ebd7-4310-830e-1f9a0a1dafe1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:57.835086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3faf73b8-ebd7-4310-830e-1f9a0a1dafe1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:57.835560 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3faf73b8-ebd7-4310-830e-1f9a0a1dafe1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:57.835990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3faf73b8-ebd7-4310-830e-1f9a0a1dafe1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:57.863991 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3faf73b8-ebd7-4310-830e-1f9a0a1dafe1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Going to try to terminate instance {{(pid=120535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:24:57.925611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-688105c3-f32a-4b6d-8bae-1198c271279d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:57.926232 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-688105c3-f32a-4b6d-8bae-1198c271279d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:57.932944 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-688105c3-f32a-4b6d-8bae-1198c271279d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:57.933550 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-688105c3-f32a-4b6d-8bae-1198c271279d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:57.933991 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-688105c3-f32a-4b6d-8bae-1198c271279d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:57.934708 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-688105c3-f32a-4b6d-8bae-1198c271279d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:57.935164 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-688105c3-f32a-4b6d-8bae-1198c271279d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:57.935616 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-688105c3-f32a-4b6d-8bae-1198c271279d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:57.958243 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-3faf73b8-ebd7-4310-830e-1f9a0a1dafe1 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 204 len: 0 microversion: 2.1 time: 0.136658 Sep 05 12:24:57.959155 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 280/561] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:24:57 2022] DELETE /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:24:57.969528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-99560274-6307-40cf-b6fe-eca803cb3e68 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:57.970240 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-99560274-6307-40cf-b6fe-eca803cb3e68 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:57.976254 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-99560274-6307-40cf-b6fe-eca803cb3e68 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:57.976748 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-99560274-6307-40cf-b6fe-eca803cb3e68 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:57.977185 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-99560274-6307-40cf-b6fe-eca803cb3e68 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:57.977887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-99560274-6307-40cf-b6fe-eca803cb3e68 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:57.978339 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-99560274-6307-40cf-b6fe-eca803cb3e68 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:57.978766 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-99560274-6307-40cf-b6fe-eca803cb3e68 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:58.082821 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-688105c3-f32a-4b6d-8bae-1198c271279d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:58.092697 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-688105c3-f32a-4b6d-8bae-1198c271279d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:58.094177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-688105c3-f32a-4b6d-8bae-1198c271279d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:58.095449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-688105c3-f32a-4b6d-8bae-1198c271279d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.174420 Sep 05 12:24:58.096054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 282/562] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:57 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:24:58.119058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-99560274-6307-40cf-b6fe-eca803cb3e68 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:58.127121 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-99560274-6307-40cf-b6fe-eca803cb3e68 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1513 microversion: 2.1 time: 0.161674 Sep 05 12:24:58.127662 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 281/563] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:57 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:24:59.121511 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-317d8eba-745a-4a74-927e-8e65ef61856d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:59.122106 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-317d8eba-745a-4a74-927e-8e65ef61856d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:59.129067 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-317d8eba-745a-4a74-927e-8e65ef61856d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:59.129583 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-317d8eba-745a-4a74-927e-8e65ef61856d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:59.130020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-317d8eba-745a-4a74-927e-8e65ef61856d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:59.130734 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-317d8eba-745a-4a74-927e-8e65ef61856d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:59.131183 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-317d8eba-745a-4a74-927e-8e65ef61856d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:59.131631 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-317d8eba-745a-4a74-927e-8e65ef61856d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:59.153120 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ee7e406c-2be8-49e3-8e97-47ca66b6a16c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:24:59.153760 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ee7e406c-2be8-49e3-8e97-47ca66b6a16c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:24:59.161056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ee7e406c-2be8-49e3-8e97-47ca66b6a16c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:59.161548 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ee7e406c-2be8-49e3-8e97-47ca66b6a16c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:59.161978 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ee7e406c-2be8-49e3-8e97-47ca66b6a16c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:59.162686 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ee7e406c-2be8-49e3-8e97-47ca66b6a16c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:24:59.163145 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ee7e406c-2be8-49e3-8e97-47ca66b6a16c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:24:59.163594 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ee7e406c-2be8-49e3-8e97-47ca66b6a16c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:24:59.314710 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-317d8eba-745a-4a74-927e-8e65ef61856d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:59.325824 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ee7e406c-2be8-49e3-8e97-47ca66b6a16c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:59.326055 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-317d8eba-745a-4a74-927e-8e65ef61856d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:59.327663 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-317d8eba-745a-4a74-927e-8e65ef61856d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:24:59.329484 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-317d8eba-745a-4a74-927e-8e65ef61856d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.211995 Sep 05 12:24:59.330366 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 283/564] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:24:59 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:24:59.334145 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ee7e406c-2be8-49e3-8e97-47ca66b6a16c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1513 microversion: 2.1 time: 0.185865 Sep 05 12:24:59.334713 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 282/565] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:24:59 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:25:00.358157 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3b060e60-3d72-4bff-9ca3-d6ce88294de5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:00.358807 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-3b060e60-3d72-4bff-9ca3-d6ce88294de5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:00.364024 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e084fe12-3937-4458-add4-0e29e21bd11c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:00.367016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e084fe12-3937-4458-add4-0e29e21bd11c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:00.378034 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3b060e60-3d72-4bff-9ca3-d6ce88294de5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:00.378155 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3b060e60-3d72-4bff-9ca3-d6ce88294de5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:00.378513 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3b060e60-3d72-4bff-9ca3-d6ce88294de5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:00.378706 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e084fe12-3937-4458-add4-0e29e21bd11c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:00.379225 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3b060e60-3d72-4bff-9ca3-d6ce88294de5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:00.379721 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3b060e60-3d72-4bff-9ca3-d6ce88294de5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:00.380145 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3b060e60-3d72-4bff-9ca3-d6ce88294de5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:00.380855 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e084fe12-3937-4458-add4-0e29e21bd11c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:00.381434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e084fe12-3937-4458-add4-0e29e21bd11c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:00.383402 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e084fe12-3937-4458-add4-0e29e21bd11c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:00.386806 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e084fe12-3937-4458-add4-0e29e21bd11c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:00.386806 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e084fe12-3937-4458-add4-0e29e21bd11c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:00.532034 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-3b060e60-3d72-4bff-9ca3-d6ce88294de5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:00.541628 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-3b060e60-3d72-4bff-9ca3-d6ce88294de5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:00.543314 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-3b060e60-3d72-4bff-9ca3-d6ce88294de5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:00.544586 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-3b060e60-3d72-4bff-9ca3-d6ce88294de5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.190415 Sep 05 12:25:00.545468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 284/566] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:25:00 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:25:00.589928 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e084fe12-3937-4458-add4-0e29e21bd11c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:00.598079 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e084fe12-3937-4458-add4-0e29e21bd11c tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1513 microversion: 2.1 time: 0.237862 Sep 05 12:25:00.598768 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 283/567] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:25:00 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:25:00.804839 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-a3dd678b-cc13-4255-a6b1-1097f2007864 req-64975d73-9b9e-41e3-aa73-74d66fd04d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6911e31-cf61-4f60-a234-f90a7678e930", "name": "network-vif-deleted", "tag": "490cb85a-153f-4bf1-a83d-4ca81c9e81a7"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:25:00.815167 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a3dd678b-cc13-4255-a6b1-1097f2007864 req-64975d73-9b9e-41e3-aa73-74d66fd04d1d service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:00.815667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a3dd678b-cc13-4255-a6b1-1097f2007864 req-64975d73-9b9e-41e3-aa73-74d66fd04d1d service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:00.816140 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a3dd678b-cc13-4255-a6b1-1097f2007864 req-64975d73-9b9e-41e3-aa73-74d66fd04d1d service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:00.829331 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-a3dd678b-cc13-4255-a6b1-1097f2007864 req-64975d73-9b9e-41e3-aa73-74d66fd04d1d service nova] Creating event network-vif-deleted:490cb85a-153f-4bf1-a83d-4ca81c9e81a7 for instance f6911e31-cf61-4f60-a234-f90a7678e930 on hv-cinder-85518 Sep 05 12:25:00.834699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-a3dd678b-cc13-4255-a6b1-1097f2007864 req-64975d73-9b9e-41e3-aa73-74d66fd04d1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111157 Sep 05 12:25:00.835302 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 285/568] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:25:01.570856 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-52e7ef52-d5c6-447b-81e9-6f0e30496219 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:01.571572 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-52e7ef52-d5c6-447b-81e9-6f0e30496219 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:01.579051 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-52e7ef52-d5c6-447b-81e9-6f0e30496219 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:01.579574 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-52e7ef52-d5c6-447b-81e9-6f0e30496219 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:01.580026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-52e7ef52-d5c6-447b-81e9-6f0e30496219 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:01.580773 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-52e7ef52-d5c6-447b-81e9-6f0e30496219 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:01.581228 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-52e7ef52-d5c6-447b-81e9-6f0e30496219 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:01.581689 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-52e7ef52-d5c6-447b-81e9-6f0e30496219 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:01.625714 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-51167173-6673-4c1b-b8dd-756532bb76e6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:01.626329 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-51167173-6673-4c1b-b8dd-756532bb76e6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:01.628384 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=32 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:01.638363 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51167173-6673-4c1b-b8dd-756532bb76e6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:01.639377 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51167173-6673-4c1b-b8dd-756532bb76e6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:01.640296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51167173-6673-4c1b-b8dd-756532bb76e6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:01.641657 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51167173-6673-4c1b-b8dd-756532bb76e6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:01.642600 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51167173-6673-4c1b-b8dd-756532bb76e6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:01.643506 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51167173-6673-4c1b-b8dd-756532bb76e6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:01.652055 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=90 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:01.706885 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51167173-6673-4c1b-b8dd-756532bb76e6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:01.707893 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51167173-6673-4c1b-b8dd-756532bb76e6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:01.708726 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51167173-6673-4c1b-b8dd-756532bb76e6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:01.709575 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.objects.instance [None req-51167173-6673-4c1b-b8dd-756532bb76e6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lazy-loading 'fault' on Instance uuid f6911e31-cf61-4f60-a234-f90a7678e930 {{(pid=120534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:25:01.733647 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-52e7ef52-d5c6-447b-81e9-6f0e30496219 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:01.742913 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-52e7ef52-d5c6-447b-81e9-6f0e30496219 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:01.745175 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-52e7ef52-d5c6-447b-81e9-6f0e30496219 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:01.746456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-52e7ef52-d5c6-447b-81e9-6f0e30496219 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.179822 Sep 05 12:25:01.747109 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 284/569] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:25:01 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:25:01.777841 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-51167173-6673-4c1b-b8dd-756532bb76e6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:01.786053 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-51167173-6673-4c1b-b8dd-756532bb76e6 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1308 microversion: 2.1 time: 0.165057 Sep 05 12:25:01.786637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 286/570] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:25:01 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1308 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:25:02.773783 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4c9305aa-acbd-45aa-be40-d01cc9e8fd8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:02.774452 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4c9305aa-acbd-45aa-be40-d01cc9e8fd8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:02.783582 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c9305aa-acbd-45aa-be40-d01cc9e8fd8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:02.784132 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c9305aa-acbd-45aa-be40-d01cc9e8fd8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:02.784611 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c9305aa-acbd-45aa-be40-d01cc9e8fd8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:02.785375 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c9305aa-acbd-45aa-be40-d01cc9e8fd8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:02.785869 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c9305aa-acbd-45aa-be40-d01cc9e8fd8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:02.786334 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c9305aa-acbd-45aa-be40-d01cc9e8fd8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:02.811383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-07fd918a-4685-4058-a151-3366072bcad7 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:02.812119 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-07fd918a-4685-4058-a151-3366072bcad7 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:02.819643 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07fd918a-4685-4058-a151-3366072bcad7 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:02.820207 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07fd918a-4685-4058-a151-3366072bcad7 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:02.820886 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07fd918a-4685-4058-a151-3366072bcad7 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:02.821706 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07fd918a-4685-4058-a151-3366072bcad7 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:02.822236 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07fd918a-4685-4058-a151-3366072bcad7 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:02.823258 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07fd918a-4685-4058-a151-3366072bcad7 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:02.859139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07fd918a-4685-4058-a151-3366072bcad7 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:02.859662 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07fd918a-4685-4058-a151-3366072bcad7 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:02.860090 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07fd918a-4685-4058-a151-3366072bcad7 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:02.861415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.objects.instance [None req-07fd918a-4685-4058-a151-3366072bcad7 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lazy-loading 'fault' on Instance uuid f6911e31-cf61-4f60-a234-f90a7678e930 {{(pid=120534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:25:02.908791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-07fd918a-4685-4058-a151-3366072bcad7 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e187162f3e64acdb8cd24f660ceeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a93fc888a145c88b28b8b73060731e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:02.917525 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-07fd918a-4685-4058-a151-3366072bcad7 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 200 len: 1308 microversion: 2.1 time: 0.110952 Sep 05 12:25:02.918119 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 287/571] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:25:02 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:25:02.940881 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4c9305aa-acbd-45aa-be40-d01cc9e8fd8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:02.951757 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4c9305aa-acbd-45aa-be40-d01cc9e8fd8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:02.953320 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4c9305aa-acbd-45aa-be40-d01cc9e8fd8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:02.954490 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4c9305aa-acbd-45aa-be40-d01cc9e8fd8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.185067 Sep 05 12:25:02.955222 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 285/572] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:25:02 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:25:03.941189 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-450652be-74bf-4036-b52b-3161cfc4ab93 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:03.941798 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-450652be-74bf-4036-b52b-3161cfc4ab93 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] [instance: f6911e31-cf61-4f60-a234-f90a7678e930] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:03.948862 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-450652be-74bf-4036-b52b-3161cfc4ab93 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:03.949342 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-450652be-74bf-4036-b52b-3161cfc4ab93 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:03.949770 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-450652be-74bf-4036-b52b-3161cfc4ab93 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:03.950470 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-450652be-74bf-4036-b52b-3161cfc4ab93 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:03.950925 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-450652be-74bf-4036-b52b-3161cfc4ab93 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:03.951342 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-450652be-74bf-4036-b52b-3161cfc4ab93 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:03.966044 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-450652be-74bf-4036-b52b-3161cfc4ab93 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] HTTP exception thrown: Instance f6911e31-cf61-4f60-a234-f90a7678e930 could not be found. Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-450652be-74bf-4036-b52b-3161cfc4ab93 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Request method failure captured: Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 HTTP/1.1 Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFenayNbRU0Qo_do2q4yR4-oZo0XogZ6CLJLkRArzwKYS2mgTAcp8W2dnqNH0NY7sDhV01cynvYS3INHPOFXysl3Q0d-W4JAkjXN7FY85o7GueX4Wuici0SoyvRRb5M1-VZuQPh44OSkDIRNF8YnK_udK1PE_md44mPdNJ8g0oVlBrzU Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 57a93fc888a145c88b28b8b73060731e Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1094691745 Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:25:03.967774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:25:03.969206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57a93fc888a145c88b28b8b73060731e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57a93fc888a145c88b28b8b73060731e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57a93fc888a145c88b28b8b73060731e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57a93fc888a145c88b28b8b73060731e"}]}] Sep 05 12:25:03.969206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-VolumesSnapshotTestJSON-1094691745 Sep 05 12:25:03.969206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 57a93fc888a145c88b28b8b73060731e Sep 05 12:25:03.969206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1094691745 Sep 05 12:25:03.969206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-VolumesSnapshotTestJSON-1094691745-project Sep 05 12:25:03.969206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:25:03.969206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:25:03.969206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 4e187162f3e64acdb8cd24f660ceeca6 Sep 05 12:25:03.969206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-VolumesSnapshotTestJSON-1094691745-project Sep 05 12:25:03.969206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:25:03.969206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance f6911e31-cf61-4f60-a234-f90a7678e930 could not be found. Sep 05 12:25:03.969206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': 'f6911e31-cf61-4f60-a234-f90a7678e930'} Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6911e31-cf61-4f60-a234-f90a7678e930 could not be found. Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:25:03.969990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6911e31-cf61-4f60-a234-f90a7678e930 could not be found. Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6911e31-cf61-4f60-a234-f90a7678e930 could not be found. Sep 05 12:25:03.971611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:25:03.972984 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-450652be-74bf-4036-b52b-3161cfc4ab93 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] Returning 404 to user: Instance f6911e31-cf61-4f60-a234-f90a7678e930 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:25:03.972984 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-450652be-74bf-4036-b52b-3161cfc4ab93 tempest-VolumesSnapshotTestJSON-1094691745 tempest-VolumesSnapshotTestJSON-1094691745-project] 10.222.0.16 "GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930" status: 404 len: 111 microversion: 2.1 time: 0.031926 Sep 05 12:25:03.972984 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 288/573] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:25:03 2022] GET /compute/v2.1/servers/f6911e31-cf61-4f60-a234-f90a7678e930 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:25:03.981661 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b41d300e-5f22-4bf3-8123-0571f2494d8e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:03.983075 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b41d300e-5f22-4bf3-8123-0571f2494d8e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:03.990648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b41d300e-5f22-4bf3-8123-0571f2494d8e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:03.991242 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b41d300e-5f22-4bf3-8123-0571f2494d8e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:03.991640 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b41d300e-5f22-4bf3-8123-0571f2494d8e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:03.992412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b41d300e-5f22-4bf3-8123-0571f2494d8e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:03.992908 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b41d300e-5f22-4bf3-8123-0571f2494d8e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:03.993337 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b41d300e-5f22-4bf3-8123-0571f2494d8e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:04.164851 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b41d300e-5f22-4bf3-8123-0571f2494d8e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:04.174361 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b41d300e-5f22-4bf3-8123-0571f2494d8e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:04.176078 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b41d300e-5f22-4bf3-8123-0571f2494d8e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:04.177277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b41d300e-5f22-4bf3-8123-0571f2494d8e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.200739 Sep 05 12:25:04.177849 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 286/574] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:25:03 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:25:05.207799 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-84cc4ac5-5a8f-4973-8776-ceedc1d6d436 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:05.208837 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-84cc4ac5-5a8f-4973-8776-ceedc1d6d436 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:05.218826 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-84cc4ac5-5a8f-4973-8776-ceedc1d6d436 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:05.219786 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-84cc4ac5-5a8f-4973-8776-ceedc1d6d436 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:05.220492 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-84cc4ac5-5a8f-4973-8776-ceedc1d6d436 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:05.221667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-84cc4ac5-5a8f-4973-8776-ceedc1d6d436 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:05.222487 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-84cc4ac5-5a8f-4973-8776-ceedc1d6d436 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:05.223266 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-84cc4ac5-5a8f-4973-8776-ceedc1d6d436 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:05.400503 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-84cc4ac5-5a8f-4973-8776-ceedc1d6d436 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:05.410462 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-84cc4ac5-5a8f-4973-8776-ceedc1d6d436 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:05.411958 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-84cc4ac5-5a8f-4973-8776-ceedc1d6d436 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:05.413138 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-84cc4ac5-5a8f-4973-8776-ceedc1d6d436 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.211691 Sep 05 12:25:05.413705 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 289/575] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:25:05 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:25:06.439285 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4b87d9b9-29ef-4811-9b97-a319c3b7ee82 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:06.439927 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4b87d9b9-29ef-4811-9b97-a319c3b7ee82 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:06.446577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4b87d9b9-29ef-4811-9b97-a319c3b7ee82 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:06.447061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4b87d9b9-29ef-4811-9b97-a319c3b7ee82 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:06.448010 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4b87d9b9-29ef-4811-9b97-a319c3b7ee82 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:06.448715 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4b87d9b9-29ef-4811-9b97-a319c3b7ee82 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:06.449173 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4b87d9b9-29ef-4811-9b97-a319c3b7ee82 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:06.449595 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4b87d9b9-29ef-4811-9b97-a319c3b7ee82 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:06.634013 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4b87d9b9-29ef-4811-9b97-a319c3b7ee82 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:06.664600 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4b87d9b9-29ef-4811-9b97-a319c3b7ee82 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:06.666469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4b87d9b9-29ef-4811-9b97-a319c3b7ee82 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:06.667805 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4b87d9b9-29ef-4811-9b97-a319c3b7ee82 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.232564 Sep 05 12:25:06.668446 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 287/576] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:25:06 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:25:07.698419 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d1c6fd72-3d88-42ac-a518-2c01afd16e34 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:07.699603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d1c6fd72-3d88-42ac-a518-2c01afd16e34 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:07.710799 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d1c6fd72-3d88-42ac-a518-2c01afd16e34 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:07.711295 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d1c6fd72-3d88-42ac-a518-2c01afd16e34 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:07.711772 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d1c6fd72-3d88-42ac-a518-2c01afd16e34 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:07.712488 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d1c6fd72-3d88-42ac-a518-2c01afd16e34 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:07.713011 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d1c6fd72-3d88-42ac-a518-2c01afd16e34 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:07.713442 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d1c6fd72-3d88-42ac-a518-2c01afd16e34 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:07.867372 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d1c6fd72-3d88-42ac-a518-2c01afd16e34 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:07.877203 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d1c6fd72-3d88-42ac-a518-2c01afd16e34 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:07.878771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d1c6fd72-3d88-42ac-a518-2c01afd16e34 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:07.880098 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d1c6fd72-3d88-42ac-a518-2c01afd16e34 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.189234 Sep 05 12:25:07.880692 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 290/577] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:25:07 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:25:08.907955 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e463bfe6-9949-4743-b430-dc4da39ff22a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:08.908515 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e463bfe6-9949-4743-b430-dc4da39ff22a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:08.915147 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e463bfe6-9949-4743-b430-dc4da39ff22a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:08.915664 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e463bfe6-9949-4743-b430-dc4da39ff22a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:08.916100 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e463bfe6-9949-4743-b430-dc4da39ff22a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:08.916784 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e463bfe6-9949-4743-b430-dc4da39ff22a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:08.917227 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e463bfe6-9949-4743-b430-dc4da39ff22a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:08.917648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e463bfe6-9949-4743-b430-dc4da39ff22a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:09.058407 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e463bfe6-9949-4743-b430-dc4da39ff22a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:09.067255 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e463bfe6-9949-4743-b430-dc4da39ff22a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:09.068731 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e463bfe6-9949-4743-b430-dc4da39ff22a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:09.069905 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e463bfe6-9949-4743-b430-dc4da39ff22a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.166379 Sep 05 12:25:09.070462 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 288/578] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:25:08 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:25:10.096116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5f725948-8556-4c39-a901-50cff712f207 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:10.096721 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5f725948-8556-4c39-a901-50cff712f207 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:10.103513 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f725948-8556-4c39-a901-50cff712f207 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:10.104013 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f725948-8556-4c39-a901-50cff712f207 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:10.104450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f725948-8556-4c39-a901-50cff712f207 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:10.105152 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f725948-8556-4c39-a901-50cff712f207 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:10.105606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f725948-8556-4c39-a901-50cff712f207 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:10.106034 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f725948-8556-4c39-a901-50cff712f207 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:10.259409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5f725948-8556-4c39-a901-50cff712f207 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:10.269377 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5f725948-8556-4c39-a901-50cff712f207 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:10.270863 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5f725948-8556-4c39-a901-50cff712f207 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:10.272133 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5f725948-8556-4c39-a901-50cff712f207 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.179926 Sep 05 12:25:10.272681 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 291/579] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:25:10 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:25:10.698399 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-9060da56-f29a-4f86-b137-1b80d9ac95a4 req-05a8cb8c-804b-480f-bb2c-ca86f1dcb032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78cd9ae3-2a60-4905-a291-30169e41c86c", "name": "network-vif-plugged", "status": "completed", "tag": "6a5ea4f2-8220-4378-84c2-dc1b033a8dd0"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:25:10.709056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-9060da56-f29a-4f86-b137-1b80d9ac95a4 req-05a8cb8c-804b-480f-bb2c-ca86f1dcb032 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:10.709541 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-9060da56-f29a-4f86-b137-1b80d9ac95a4 req-05a8cb8c-804b-480f-bb2c-ca86f1dcb032 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:10.709975 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-9060da56-f29a-4f86-b137-1b80d9ac95a4 req-05a8cb8c-804b-480f-bb2c-ca86f1dcb032 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:10.722210 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-9060da56-f29a-4f86-b137-1b80d9ac95a4 req-05a8cb8c-804b-480f-bb2c-ca86f1dcb032 service nova] Creating event network-vif-plugged:6a5ea4f2-8220-4378-84c2-dc1b033a8dd0 for instance 78cd9ae3-2a60-4905-a291-30169e41c86c on hv-cinder-85518 Sep 05 12:25:10.727455 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-9060da56-f29a-4f86-b137-1b80d9ac95a4 req-05a8cb8c-804b-480f-bb2c-ca86f1dcb032 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091209 Sep 05 12:25:10.728087 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 289/580] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:25:11.309918 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b18b194f-c155-409e-900f-19b7b5e071d5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:11.310691 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b18b194f-c155-409e-900f-19b7b5e071d5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:11.317968 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b18b194f-c155-409e-900f-19b7b5e071d5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:11.318447 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b18b194f-c155-409e-900f-19b7b5e071d5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:11.318877 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b18b194f-c155-409e-900f-19b7b5e071d5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:11.319656 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b18b194f-c155-409e-900f-19b7b5e071d5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:11.320109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b18b194f-c155-409e-900f-19b7b5e071d5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:11.320529 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b18b194f-c155-409e-900f-19b7b5e071d5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:11.451397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b18b194f-c155-409e-900f-19b7b5e071d5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:11.460030 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b18b194f-c155-409e-900f-19b7b5e071d5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:11.461479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b18b194f-c155-409e-900f-19b7b5e071d5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:11.462635 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b18b194f-c155-409e-900f-19b7b5e071d5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.156644 Sep 05 12:25:11.463865 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 292/581] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:25:11 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:25:12.490016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1caaa8d7-56c6-45e1-a491-3d601fd1a4a0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:12.490752 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-1caaa8d7-56c6-45e1-a491-3d601fd1a4a0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:12.498112 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1caaa8d7-56c6-45e1-a491-3d601fd1a4a0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:12.498604 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1caaa8d7-56c6-45e1-a491-3d601fd1a4a0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:12.499044 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1caaa8d7-56c6-45e1-a491-3d601fd1a4a0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:12.499880 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1caaa8d7-56c6-45e1-a491-3d601fd1a4a0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:12.500347 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1caaa8d7-56c6-45e1-a491-3d601fd1a4a0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:12.500780 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1caaa8d7-56c6-45e1-a491-3d601fd1a4a0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:12.659125 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1caaa8d7-56c6-45e1-a491-3d601fd1a4a0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:12.669203 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1caaa8d7-56c6-45e1-a491-3d601fd1a4a0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:12.670690 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1caaa8d7-56c6-45e1-a491-3d601fd1a4a0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:12.671896 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1caaa8d7-56c6-45e1-a491-3d601fd1a4a0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.186988 Sep 05 12:25:12.672458 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 290/582] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:25:12 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:25:13.698122 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-136f0a69-b142-49e5-941c-e7f392b924fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:13.698734 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-136f0a69-b142-49e5-941c-e7f392b924fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:13.706465 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-136f0a69-b142-49e5-941c-e7f392b924fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:13.710806 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-136f0a69-b142-49e5-941c-e7f392b924fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:13.710806 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-136f0a69-b142-49e5-941c-e7f392b924fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:13.710806 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-136f0a69-b142-49e5-941c-e7f392b924fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:13.710806 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-136f0a69-b142-49e5-941c-e7f392b924fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:13.711391 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-136f0a69-b142-49e5-941c-e7f392b924fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:13.865385 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-136f0a69-b142-49e5-941c-e7f392b924fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:13.875123 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-136f0a69-b142-49e5-941c-e7f392b924fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:13.876687 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-136f0a69-b142-49e5-941c-e7f392b924fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:13.877926 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-136f0a69-b142-49e5-941c-e7f392b924fb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1808 microversion: 2.20 time: 0.183741 Sep 05 12:25:13.878502 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 293/583] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:25:13 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:25:14.907569 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5a9e3d5e-7c94-4491-baa2-d20cd80ae597 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:14.908512 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5a9e3d5e-7c94-4491-baa2-d20cd80ae597 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:14.943563 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a9e3d5e-7c94-4491-baa2-d20cd80ae597 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:14.944176 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a9e3d5e-7c94-4491-baa2-d20cd80ae597 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:14.944619 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a9e3d5e-7c94-4491-baa2-d20cd80ae597 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:14.945365 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a9e3d5e-7c94-4491-baa2-d20cd80ae597 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:14.945814 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a9e3d5e-7c94-4491-baa2-d20cd80ae597 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:14.946236 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a9e3d5e-7c94-4491-baa2-d20cd80ae597 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:15.086939 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5a9e3d5e-7c94-4491-baa2-d20cd80ae597 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:15.095990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5a9e3d5e-7c94-4491-baa2-d20cd80ae597 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:15.097435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5a9e3d5e-7c94-4491-baa2-d20cd80ae597 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:15.098640 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5a9e3d5e-7c94-4491-baa2-d20cd80ae597 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1795 microversion: 2.20 time: 0.198434 Sep 05 12:25:15.099207 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 291/584] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:25:14 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1795 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:25:41.418671 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=19 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:41.419482 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=47 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:41.420286 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:25:41.420467 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Mon Sep 5 12:25:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Sep 05 12:25:41.609089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4971d867-31bb-4b95-8c00-30d8bf6c2ec7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Action: 'create', calling method: .version_select at 0x7fba4b8b0820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-246234878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDRNRVBjys3Bloyrym65H6wUgjAxFVXMg1rhBuj5/ekuSV2kOrth5J8jrm9Ighll63PV1f0r6v9VWdZz+oEZLi5s8CfnsoaG3BHmsq+8iIXcjs2KTaDX90mLAYEnyGMqw=="}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:25:41.624858 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-4971d867-31bb-4b95-8c00-30d8bf6c2ec7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Getting quotas for project 4d5cb05cfc60481fa4144ee7b077ca4f. Resources: {'key_pairs'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:25:41.628901 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-4971d867-31bb-4b95-8c00-30d8bf6c2ec7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Getting quotas for user ebd8a00f21344c7990ffe1a7ff2986ef and project 4d5cb05cfc60481fa4144ee7b077ca4f. Resources: {'key_pairs'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:25:41.671257 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4971d867-31bb-4b95-8c00-30d8bf6c2ec7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.257707 Sep 05 12:25:41.672334 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 294/585] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Sep 5 12:25:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:25:47.270025 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-fa6bc1a0-438c-4b8f-ae80-4e69e95c7761 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "300fc6ef-2603-4e6c-9b2c-9a7874cc32c2"}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:25:47.272466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-fa6bc1a0-438c-4b8f-ae80-4e69e95c7761 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:47.274655 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:47.275461 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:47.284670 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fa6bc1a0-438c-4b8f-ae80-4e69e95c7761 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:47.285303 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fa6bc1a0-438c-4b8f-ae80-4e69e95c7761 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:47.285870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fa6bc1a0-438c-4b8f-ae80-4e69e95c7761 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:47.286780 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fa6bc1a0-438c-4b8f-ae80-4e69e95c7761 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:47.287402 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fa6bc1a0-438c-4b8f-ae80-4e69e95c7761 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:47.287985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fa6bc1a0-438c-4b8f-ae80-4e69e95c7761 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:47.588275 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-fa6bc1a0-438c-4b8f-ae80-4e69e95c7761 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "POST /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323091 Sep 05 12:25:47.588888 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 292/586] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Sep 5 12:25:47 2022] POST /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:25:48.255667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9df7f4f1-df7e-4c33-99d2-29301edffe54 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:48.256233 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9df7f4f1-df7e-4c33-99d2-29301edffe54 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:48.263027 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9df7f4f1-df7e-4c33-99d2-29301edffe54 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:48.263560 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9df7f4f1-df7e-4c33-99d2-29301edffe54 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:48.263999 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9df7f4f1-df7e-4c33-99d2-29301edffe54 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:48.264688 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9df7f4f1-df7e-4c33-99d2-29301edffe54 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:48.265290 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9df7f4f1-df7e-4c33-99d2-29301edffe54 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:48.265854 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9df7f4f1-df7e-4c33-99d2-29301edffe54 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:48.348653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.objects.instance [None req-9df7f4f1-df7e-4c33-99d2-29301edffe54 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lazy-loading 'services' on Instance uuid b78eb7b3-fb70-404b-b598-c80dd26f2827 {{(pid=120534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:25:48.433852 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9df7f4f1-df7e-4c33-99d2-29301edffe54 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/os-volume_attachments/f6ce9c2f-409c-42ff-8ff0-15af062d8859" status: 202 len: 0 microversion: 2.1 time: 0.287457 Sep 05 12:25:48.434818 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 295/587] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Sep 5 12:25:48 2022] DELETE /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/os-volume_attachments/f6ce9c2f-409c-42ff-8ff0-15af062d8859 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:25:55.129474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:25:55.129989 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Mon Sep 5 12:25:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/action (ip 10.222.0.16) !!! Sep 05 12:25:55.134646 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b3cd0685-8868-4a71-b92f-906ee098a7c5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:25:55.137042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b3cd0685-8868-4a71-b92f-906ee098a7c5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:55.144908 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b3cd0685-8868-4a71-b92f-906ee098a7c5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:55.145393 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b3cd0685-8868-4a71-b92f-906ee098a7c5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:55.145835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b3cd0685-8868-4a71-b92f-906ee098a7c5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:55.146520 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b3cd0685-8868-4a71-b92f-906ee098a7c5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:55.146977 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b3cd0685-8868-4a71-b92f-906ee098a7c5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:55.147403 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b3cd0685-8868-4a71-b92f-906ee098a7c5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:55.171884 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-b3cd0685-8868-4a71-b92f-906ee098a7c5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lazy-loading 'flavor' on Instance uuid f64534ca-02f1-4369-94ac-1b50a063b870 {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:25:55.300858 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b3cd0685-8868-4a71-b92f-906ee098a7c5 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "POST /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/action" status: 200 len: 32 microversion: 2.1 time: 0.173124 Sep 05 12:25:55.301465 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 293/588] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Sep 5 12:25:55 2022] POST /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:25:55.309177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=4 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:55.315642 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9673fbe4-addb-4315-ba25-1d57640319a9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:55.316608 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9673fbe4-addb-4315-ba25-1d57640319a9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:55.325459 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9673fbe4-addb-4315-ba25-1d57640319a9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:55.325961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9673fbe4-addb-4315-ba25-1d57640319a9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:55.327148 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9673fbe4-addb-4315-ba25-1d57640319a9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:55.328024 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9673fbe4-addb-4315-ba25-1d57640319a9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:55.328698 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9673fbe4-addb-4315-ba25-1d57640319a9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:55.329134 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9673fbe4-addb-4315-ba25-1d57640319a9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:55.514501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9673fbe4-addb-4315-ba25-1d57640319a9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:55.532018 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9673fbe4-addb-4315-ba25-1d57640319a9 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1734 microversion: 2.1 time: 0.223890 Sep 05 12:25:55.535304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 296/589] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:25:55 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1734 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:25:56.561820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2ac25069-1e19-47ab-b0d8-bb088e5a22b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:56.562517 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2ac25069-1e19-47ab-b0d8-bb088e5a22b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:56.569775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2ac25069-1e19-47ab-b0d8-bb088e5a22b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:56.570257 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2ac25069-1e19-47ab-b0d8-bb088e5a22b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:56.570684 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2ac25069-1e19-47ab-b0d8-bb088e5a22b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:56.571379 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2ac25069-1e19-47ab-b0d8-bb088e5a22b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:56.571868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2ac25069-1e19-47ab-b0d8-bb088e5a22b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:56.572290 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2ac25069-1e19-47ab-b0d8-bb088e5a22b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:56.705269 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2ac25069-1e19-47ab-b0d8-bb088e5a22b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:56.714374 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2ac25069-1e19-47ab-b0d8-bb088e5a22b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1734 microversion: 2.1 time: 0.157730 Sep 05 12:25:56.714962 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 294/590] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:25:56 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:25:57.036623 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-79d2af3b-f056-4eea-ace1-31f4c153c581 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:25:57.043139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79d2af3b-f056-4eea-ace1-31f4c153c581 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:57.043667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79d2af3b-f056-4eea-ace1-31f4c153c581 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:57.044109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79d2af3b-f056-4eea-ace1-31f4c153c581 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:57.066579 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-79d2af3b-f056-4eea-ace1-31f4c153c581 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Going to try to stop instance {{(pid=120534) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 05 12:25:57.115074 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-79d2af3b-f056-4eea-ace1-31f4c153c581 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "POST /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/action" status: 202 len: 0 microversion: 2.1 time: 0.082113 Sep 05 12:25:57.115715 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 297/591] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Sep 5 12:25:57 2022] POST /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:25:57.124328 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-94d27a75-1d9a-4a89-b872-ce4e437801f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:57.124972 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-94d27a75-1d9a-4a89-b872-ce4e437801f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:57.131641 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-94d27a75-1d9a-4a89-b872-ce4e437801f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:57.132465 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-94d27a75-1d9a-4a89-b872-ce4e437801f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:57.133183 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-94d27a75-1d9a-4a89-b872-ce4e437801f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:57.133961 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-94d27a75-1d9a-4a89-b872-ce4e437801f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:57.134466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-94d27a75-1d9a-4a89-b872-ce4e437801f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:57.135046 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-94d27a75-1d9a-4a89-b872-ce4e437801f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:57.280701 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-94d27a75-1d9a-4a89-b872-ce4e437801f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:57.288342 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-94d27a75-1d9a-4a89-b872-ce4e437801f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1678 microversion: 2.1 time: 0.168462 Sep 05 12:25:57.288910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 295/592] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:25:57 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:25:57.739624 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-87f31630-c239-4482-a69f-76783645eac1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:57.740321 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-87f31630-c239-4482-a69f-76783645eac1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:57.746535 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87f31630-c239-4482-a69f-76783645eac1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:57.747030 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87f31630-c239-4482-a69f-76783645eac1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:57.747471 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87f31630-c239-4482-a69f-76783645eac1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:57.748193 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87f31630-c239-4482-a69f-76783645eac1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:57.749291 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87f31630-c239-4482-a69f-76783645eac1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:57.749740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87f31630-c239-4482-a69f-76783645eac1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:58.036604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-87f31630-c239-4482-a69f-76783645eac1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:58.045083 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-87f31630-c239-4482-a69f-76783645eac1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1734 microversion: 2.1 time: 0.309665 Sep 05 12:25:58.046284 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 298/593] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:25:57 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1734 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:25:58.311159 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-337dae30-85d9-44a3-9e19-1cd3d5683a36 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:58.311809 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-337dae30-85d9-44a3-9e19-1cd3d5683a36 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:58.318279 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-337dae30-85d9-44a3-9e19-1cd3d5683a36 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:58.318760 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-337dae30-85d9-44a3-9e19-1cd3d5683a36 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:58.319195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-337dae30-85d9-44a3-9e19-1cd3d5683a36 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:58.319913 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-337dae30-85d9-44a3-9e19-1cd3d5683a36 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:58.320368 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-337dae30-85d9-44a3-9e19-1cd3d5683a36 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:58.320801 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-337dae30-85d9-44a3-9e19-1cd3d5683a36 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:58.450629 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-337dae30-85d9-44a3-9e19-1cd3d5683a36 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:58.458825 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-337dae30-85d9-44a3-9e19-1cd3d5683a36 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1678 microversion: 2.1 time: 0.151463 Sep 05 12:25:58.459383 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 296/594] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:25:58 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:25:59.068154 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-215e4a55-328b-45c8-a0a9-e4da07fda000 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:59.068775 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-215e4a55-328b-45c8-a0a9-e4da07fda000 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:59.075350 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-215e4a55-328b-45c8-a0a9-e4da07fda000 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:59.075865 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-215e4a55-328b-45c8-a0a9-e4da07fda000 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:59.076302 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-215e4a55-328b-45c8-a0a9-e4da07fda000 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:59.077005 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-215e4a55-328b-45c8-a0a9-e4da07fda000 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:59.077465 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-215e4a55-328b-45c8-a0a9-e4da07fda000 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:59.077896 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-215e4a55-328b-45c8-a0a9-e4da07fda000 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:59.208718 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-215e4a55-328b-45c8-a0a9-e4da07fda000 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:59.217582 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-215e4a55-328b-45c8-a0a9-e4da07fda000 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1734 microversion: 2.1 time: 0.153079 Sep 05 12:25:59.218372 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 299/595] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:25:59 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:25:59.482422 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-279686d7-47ec-4596-a149-72710b01ce56 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:25:59.483588 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-279686d7-47ec-4596-a149-72710b01ce56 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:25:59.489950 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-279686d7-47ec-4596-a149-72710b01ce56 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:59.490426 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-279686d7-47ec-4596-a149-72710b01ce56 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:59.490858 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-279686d7-47ec-4596-a149-72710b01ce56 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:59.491554 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-279686d7-47ec-4596-a149-72710b01ce56 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:25:59.492005 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-279686d7-47ec-4596-a149-72710b01ce56 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:25:59.492444 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-279686d7-47ec-4596-a149-72710b01ce56 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:25:59.623145 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-279686d7-47ec-4596-a149-72710b01ce56 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:25:59.630869 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-279686d7-47ec-4596-a149-72710b01ce56 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1678 microversion: 2.1 time: 0.152396 Sep 05 12:25:59.631425 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 297/596] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:25:59 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:00.241405 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b32aee00-e93b-4175-8469-c2381ebd0411 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:00.242934 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b32aee00-e93b-4175-8469-c2381ebd0411 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:00.250198 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b32aee00-e93b-4175-8469-c2381ebd0411 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:00.250690 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b32aee00-e93b-4175-8469-c2381ebd0411 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:00.251225 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b32aee00-e93b-4175-8469-c2381ebd0411 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:00.251887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b32aee00-e93b-4175-8469-c2381ebd0411 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:00.252342 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b32aee00-e93b-4175-8469-c2381ebd0411 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:00.252771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b32aee00-e93b-4175-8469-c2381ebd0411 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:00.385287 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b32aee00-e93b-4175-8469-c2381ebd0411 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:00.395598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b32aee00-e93b-4175-8469-c2381ebd0411 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1734 microversion: 2.1 time: 0.157940 Sep 05 12:26:00.396188 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 300/597] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:00 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:00.653771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7f72a908-9afb-4db4-a1eb-6e6d02c59794 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:00.654439 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7f72a908-9afb-4db4-a1eb-6e6d02c59794 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:00.661417 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f72a908-9afb-4db4-a1eb-6e6d02c59794 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:00.661903 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f72a908-9afb-4db4-a1eb-6e6d02c59794 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:00.662339 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f72a908-9afb-4db4-a1eb-6e6d02c59794 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:00.663038 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f72a908-9afb-4db4-a1eb-6e6d02c59794 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:00.663500 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f72a908-9afb-4db4-a1eb-6e6d02c59794 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:00.663952 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f72a908-9afb-4db4-a1eb-6e6d02c59794 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:00.803737 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-7f72a908-9afb-4db4-a1eb-6e6d02c59794 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:00.813182 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7f72a908-9afb-4db4-a1eb-6e6d02c59794 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1678 microversion: 2.1 time: 0.163767 Sep 05 12:26:00.813755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 298/598] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:00 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:01.419481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-02822115-cf44-4bbe-91ff-cf954c4fca20 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:01.420121 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-02822115-cf44-4bbe-91ff-cf954c4fca20 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:01.426685 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-02822115-cf44-4bbe-91ff-cf954c4fca20 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:01.427165 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-02822115-cf44-4bbe-91ff-cf954c4fca20 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:01.427654 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-02822115-cf44-4bbe-91ff-cf954c4fca20 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:01.428347 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-02822115-cf44-4bbe-91ff-cf954c4fca20 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:01.429131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-02822115-cf44-4bbe-91ff-cf954c4fca20 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:01.429276 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-02822115-cf44-4bbe-91ff-cf954c4fca20 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:01.563922 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-02822115-cf44-4bbe-91ff-cf954c4fca20 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:01.572172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-02822115-cf44-4bbe-91ff-cf954c4fca20 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1734 microversion: 2.1 time: 0.156543 Sep 05 12:26:01.572743 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 301/599] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:01 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:01.836845 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0c2a6fa2-38ff-4ea4-8d70-84fa0d1c3111 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:01.837462 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0c2a6fa2-38ff-4ea4-8d70-84fa0d1c3111 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:01.844020 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0c2a6fa2-38ff-4ea4-8d70-84fa0d1c3111 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:01.844512 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0c2a6fa2-38ff-4ea4-8d70-84fa0d1c3111 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:01.844954 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0c2a6fa2-38ff-4ea4-8d70-84fa0d1c3111 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:01.845657 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0c2a6fa2-38ff-4ea4-8d70-84fa0d1c3111 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:01.846108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0c2a6fa2-38ff-4ea4-8d70-84fa0d1c3111 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:01.846532 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0c2a6fa2-38ff-4ea4-8d70-84fa0d1c3111 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:01.980885 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0c2a6fa2-38ff-4ea4-8d70-84fa0d1c3111 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:01.989353 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0c2a6fa2-38ff-4ea4-8d70-84fa0d1c3111 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1678 microversion: 2.1 time: 0.156503 Sep 05 12:26:01.989922 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 299/600] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:01 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:02.596272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b7c98fcb-8b19-482d-8a88-37c9a2048f90 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:02.596875 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b7c98fcb-8b19-482d-8a88-37c9a2048f90 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:02.603424 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b7c98fcb-8b19-482d-8a88-37c9a2048f90 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:02.603960 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b7c98fcb-8b19-482d-8a88-37c9a2048f90 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:02.604395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b7c98fcb-8b19-482d-8a88-37c9a2048f90 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:02.605087 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b7c98fcb-8b19-482d-8a88-37c9a2048f90 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:02.605538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b7c98fcb-8b19-482d-8a88-37c9a2048f90 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:02.605961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b7c98fcb-8b19-482d-8a88-37c9a2048f90 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:02.757943 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b7c98fcb-8b19-482d-8a88-37c9a2048f90 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:02.767581 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b7c98fcb-8b19-482d-8a88-37c9a2048f90 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1734 microversion: 2.1 time: 0.175603 Sep 05 12:26:02.768393 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 302/601] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:02 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:03.014730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-40d212ff-dad1-4cbf-b8d8-02a07d69e8ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:03.015348 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-40d212ff-dad1-4cbf-b8d8-02a07d69e8ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:03.022391 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-40d212ff-dad1-4cbf-b8d8-02a07d69e8ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:03.022877 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-40d212ff-dad1-4cbf-b8d8-02a07d69e8ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:03.023311 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-40d212ff-dad1-4cbf-b8d8-02a07d69e8ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:03.024048 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-40d212ff-dad1-4cbf-b8d8-02a07d69e8ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:03.024500 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-40d212ff-dad1-4cbf-b8d8-02a07d69e8ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:03.024921 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-40d212ff-dad1-4cbf-b8d8-02a07d69e8ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:03.160610 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-40d212ff-dad1-4cbf-b8d8-02a07d69e8ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:03.168548 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-40d212ff-dad1-4cbf-b8d8-02a07d69e8ae tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1678 microversion: 2.1 time: 0.158542 Sep 05 12:26:03.169117 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 300/602] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:03 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:03.792509 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-52c79738-56f8-4fa0-b063-e8ec923c4532 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:03.793120 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-52c79738-56f8-4fa0-b063-e8ec923c4532 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:03.800556 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52c79738-56f8-4fa0-b063-e8ec923c4532 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:03.801052 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52c79738-56f8-4fa0-b063-e8ec923c4532 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:03.801490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52c79738-56f8-4fa0-b063-e8ec923c4532 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:03.802205 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52c79738-56f8-4fa0-b063-e8ec923c4532 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:03.802665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52c79738-56f8-4fa0-b063-e8ec923c4532 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:03.803094 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52c79738-56f8-4fa0-b063-e8ec923c4532 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:03.942650 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-52c79738-56f8-4fa0-b063-e8ec923c4532 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:03.951776 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-52c79738-56f8-4fa0-b063-e8ec923c4532 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1734 microversion: 2.1 time: 0.163136 Sep 05 12:26:03.952364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 303/603] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:03 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:04.194629 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-dee8d041-fc07-4178-8ad4-a911d45bf91f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:04.195625 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-dee8d041-fc07-4178-8ad4-a911d45bf91f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:04.205054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dee8d041-fc07-4178-8ad4-a911d45bf91f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:04.205746 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dee8d041-fc07-4178-8ad4-a911d45bf91f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:04.206399 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dee8d041-fc07-4178-8ad4-a911d45bf91f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:04.207348 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dee8d041-fc07-4178-8ad4-a911d45bf91f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:04.208049 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dee8d041-fc07-4178-8ad4-a911d45bf91f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:04.208617 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dee8d041-fc07-4178-8ad4-a911d45bf91f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:04.350288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-dee8d041-fc07-4178-8ad4-a911d45bf91f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:04.358553 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-dee8d041-fc07-4178-8ad4-a911d45bf91f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1678 microversion: 2.1 time: 0.169693 Sep 05 12:26:04.359145 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 301/604] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:04 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:04.991765 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-cea5671d-c460-476f-83b1-19a6b2fb6c44 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:04.991765 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-cea5671d-c460-476f-83b1-19a6b2fb6c44 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:04.998561 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cea5671d-c460-476f-83b1-19a6b2fb6c44 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:04.999048 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cea5671d-c460-476f-83b1-19a6b2fb6c44 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:04.999487 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cea5671d-c460-476f-83b1-19a6b2fb6c44 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:05.000812 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cea5671d-c460-476f-83b1-19a6b2fb6c44 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:05.001272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cea5671d-c460-476f-83b1-19a6b2fb6c44 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:05.001708 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cea5671d-c460-476f-83b1-19a6b2fb6c44 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:05.137194 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-cea5671d-c460-476f-83b1-19a6b2fb6c44 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:05.145556 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-cea5671d-c460-476f-83b1-19a6b2fb6c44 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1734 microversion: 2.1 time: 0.158318 Sep 05 12:26:05.146137 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 304/605] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:04 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:05.381388 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0f4109e7-54e7-4c84-8ece-06ccf15c67f8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:05.382007 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0f4109e7-54e7-4c84-8ece-06ccf15c67f8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:05.388828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0f4109e7-54e7-4c84-8ece-06ccf15c67f8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:05.389317 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0f4109e7-54e7-4c84-8ece-06ccf15c67f8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:05.389756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0f4109e7-54e7-4c84-8ece-06ccf15c67f8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:05.390453 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0f4109e7-54e7-4c84-8ece-06ccf15c67f8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:05.390913 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0f4109e7-54e7-4c84-8ece-06ccf15c67f8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:05.391336 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0f4109e7-54e7-4c84-8ece-06ccf15c67f8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:05.532106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0f4109e7-54e7-4c84-8ece-06ccf15c67f8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:05.540030 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0f4109e7-54e7-4c84-8ece-06ccf15c67f8 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1678 microversion: 2.1 time: 0.162489 Sep 05 12:26:05.540599 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 302/606] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:05 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:06.170882 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ce6f4dd4-46ae-44c9-ab42-254912e531cd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:06.171498 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ce6f4dd4-46ae-44c9-ab42-254912e531cd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:06.178119 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ce6f4dd4-46ae-44c9-ab42-254912e531cd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:06.178514 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ce6f4dd4-46ae-44c9-ab42-254912e531cd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:06.178955 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ce6f4dd4-46ae-44c9-ab42-254912e531cd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:06.179682 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ce6f4dd4-46ae-44c9-ab42-254912e531cd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:06.180143 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ce6f4dd4-46ae-44c9-ab42-254912e531cd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:06.180592 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ce6f4dd4-46ae-44c9-ab42-254912e531cd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:06.326570 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ce6f4dd4-46ae-44c9-ab42-254912e531cd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:06.336067 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ce6f4dd4-46ae-44c9-ab42-254912e531cd tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1734 microversion: 2.1 time: 0.168988 Sep 05 12:26:06.336682 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 305/607] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:06 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:06.564010 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a674dc7b-00b3-491d-829b-415c13c880f1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:06.564604 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a674dc7b-00b3-491d-829b-415c13c880f1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:06.571117 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a674dc7b-00b3-491d-829b-415c13c880f1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:06.571650 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a674dc7b-00b3-491d-829b-415c13c880f1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:06.572104 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a674dc7b-00b3-491d-829b-415c13c880f1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:06.572791 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a674dc7b-00b3-491d-829b-415c13c880f1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:06.573244 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a674dc7b-00b3-491d-829b-415c13c880f1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:06.573669 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a674dc7b-00b3-491d-829b-415c13c880f1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:06.705684 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a674dc7b-00b3-491d-829b-415c13c880f1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:06.713323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a674dc7b-00b3-491d-829b-415c13c880f1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1678 microversion: 2.1 time: 0.153955 Sep 05 12:26:06.713883 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 303/608] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:06 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:07.360334 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-38c15ca4-72ee-492d-8845-ce4bbff94dde tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:07.360965 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-38c15ca4-72ee-492d-8845-ce4bbff94dde tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:07.367341 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-38c15ca4-72ee-492d-8845-ce4bbff94dde tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:07.367867 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-38c15ca4-72ee-492d-8845-ce4bbff94dde tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:07.368395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-38c15ca4-72ee-492d-8845-ce4bbff94dde tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:07.369098 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-38c15ca4-72ee-492d-8845-ce4bbff94dde tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:07.369587 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-38c15ca4-72ee-492d-8845-ce4bbff94dde tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:07.370015 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-38c15ca4-72ee-492d-8845-ce4bbff94dde tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:07.506541 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-38c15ca4-72ee-492d-8845-ce4bbff94dde tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:07.515502 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-38c15ca4-72ee-492d-8845-ce4bbff94dde tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1734 microversion: 2.1 time: 0.158987 Sep 05 12:26:07.516600 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 306/609] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:07 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:07.667931 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1919288545", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-246234878", "security_groups": [{"name": "tempest-secgroup-smoke-42412145"}], "block_device_mapping_v2": [{"uuid": "ed2b76ec-bf76-4c4d-97f3-3661631afd9f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "22599f3e-588a-4fed-83e5-f9c661808b8f"}]}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:26:07.736929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-50c6ddae-038c-445b-be7b-007e654327c5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:07.737547 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-50c6ddae-038c-445b-be7b-007e654327c5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:07.744646 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-50c6ddae-038c-445b-be7b-007e654327c5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:07.745137 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-50c6ddae-038c-445b-be7b-007e654327c5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:07.745576 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-50c6ddae-038c-445b-be7b-007e654327c5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:07.746271 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-50c6ddae-038c-445b-be7b-007e654327c5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:07.746732 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-50c6ddae-038c-445b-be7b-007e654327c5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:07.747168 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-50c6ddae-038c-445b-be7b-007e654327c5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:07.786717 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.network.neutron [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] validate_networks() for [('22599f3e-588a-4fed-83e5-f9c661808b8f', None, None, None, None, None)] {{(pid=120535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:26:07.889983 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-50c6ddae-038c-445b-be7b-007e654327c5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:07.898833 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-50c6ddae-038c-445b-be7b-007e654327c5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1678 microversion: 2.1 time: 0.165845 Sep 05 12:26:07.899418 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 307/610] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:07 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:26:08.168694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Flavor limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:26:08.169120 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Image limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:26:08.169696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Flavor pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:26:08.170115 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Image pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:26:08.170526 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:26:08.180767 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:08.181401 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:08.181957 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:08.182755 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:08.183215 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:08.183683 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:08.202298 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Getting quotas for project 4d5cb05cfc60481fa4144ee7b077ca4f. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:26:08.206321 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Getting quotas for user ebd8a00f21344c7990ffe1a7ff2986ef and project 4d5cb05cfc60481fa4144ee7b077ca4f. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:26:08.271381 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Going to run 1 instances... {{(pid=120535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:26:08.273538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed2b76ec-bf76-4c4d-97f3-3661631afd9f',volume_size=None,volume_type=None)] {{(pid=120535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:26:08.449648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-12be9757-f2f7-4e15-a496-4a39732182b4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.785652 Sep 05 12:26:08.457552 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 304/611] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:26:07 2022] POST /compute/v2.1/servers => generated 404 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:26:08.469790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e9bf486a-4286-4307-81b0-3040e0923681 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:08.470419 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e9bf486a-4286-4307-81b0-3040e0923681 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:08.539215 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-057d9cf2-0233-4405-bd7b-a4ecc5eec463 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:08.540137 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-057d9cf2-0233-4405-bd7b-a4ecc5eec463 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:08.550499 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-057d9cf2-0233-4405-bd7b-a4ecc5eec463 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:08.550986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-057d9cf2-0233-4405-bd7b-a4ecc5eec463 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:08.551413 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-057d9cf2-0233-4405-bd7b-a4ecc5eec463 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:08.552135 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-057d9cf2-0233-4405-bd7b-a4ecc5eec463 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:08.552583 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-057d9cf2-0233-4405-bd7b-a4ecc5eec463 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:08.553003 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-057d9cf2-0233-4405-bd7b-a4ecc5eec463 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:08.582731 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e9bf486a-4286-4307-81b0-3040e0923681 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:08.595567 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e9bf486a-4286-4307-81b0-3040e0923681 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1094 microversion: 2.1 time: 0.129816 Sep 05 12:26:08.595567 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 308/612] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:08 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1094 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:08.756702 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-057d9cf2-0233-4405-bd7b-a4ecc5eec463 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:08.761321 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:08.770308 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-057d9cf2-0233-4405-bd7b-a4ecc5eec463 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1734 microversion: 2.1 time: 0.234564 Sep 05 12:26:08.771211 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 305/613] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:08 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1734 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:08.923560 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-800fef0c-f685-4c2c-a416-20cbffed06a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:08.924656 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-800fef0c-f685-4c2c-a416-20cbffed06a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:08.933173 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-800fef0c-f685-4c2c-a416-20cbffed06a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:08.933990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-800fef0c-f685-4c2c-a416-20cbffed06a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:08.934606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-800fef0c-f685-4c2c-a416-20cbffed06a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:08.935587 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-800fef0c-f685-4c2c-a416-20cbffed06a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:08.936186 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-800fef0c-f685-4c2c-a416-20cbffed06a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:08.936757 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-800fef0c-f685-4c2c-a416-20cbffed06a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:09.082637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-800fef0c-f685-4c2c-a416-20cbffed06a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:09.096049 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-800fef0c-f685-4c2c-a416-20cbffed06a5 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1655 microversion: 2.1 time: 0.177631 Sep 05 12:26:09.096673 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 309/614] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:08 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1655 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:09.121316 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9208a481-075c-4bd9-9e91-bd059a992be4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:26:09.128808 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9208a481-075c-4bd9-9e91-bd059a992be4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:09.129298 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9208a481-075c-4bd9-9e91-bd059a992be4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:09.129738 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9208a481-075c-4bd9-9e91-bd059a992be4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:09.203801 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-9208a481-075c-4bd9-9e91-bd059a992be4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Going to try to start instance {{(pid=120535) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 05 12:26:09.253175 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9208a481-075c-4bd9-9e91-bd059a992be4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "POST /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/action" status: 202 len: 0 microversion: 2.1 time: 0.137455 Sep 05 12:26:09.253798 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 306/615] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Sep 5 12:26:09 2022] POST /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 12:26:09.262590 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-af325829-d5c0-42c2-a111-2f5ff8b30726 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:09.263214 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-af325829-d5c0-42c2-a111-2f5ff8b30726 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:09.272894 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af325829-d5c0-42c2-a111-2f5ff8b30726 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:09.272894 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af325829-d5c0-42c2-a111-2f5ff8b30726 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:09.272894 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af325829-d5c0-42c2-a111-2f5ff8b30726 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:09.273397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af325829-d5c0-42c2-a111-2f5ff8b30726 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:09.273569 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af325829-d5c0-42c2-a111-2f5ff8b30726 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:09.274077 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af325829-d5c0-42c2-a111-2f5ff8b30726 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:09.417691 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-af325829-d5c0-42c2-a111-2f5ff8b30726 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:09.421251 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:09.427322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-af325829-d5c0-42c2-a111-2f5ff8b30726 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1664 microversion: 2.1 time: 0.168722 Sep 05 12:26:09.427936 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 310/616] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:09 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:09.617061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1073073a-e669-4957-a8f3-0332d51da37d tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:09.617750 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-1073073a-e669-4957-a8f3-0332d51da37d tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:09.626702 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1073073a-e669-4957-a8f3-0332d51da37d tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:09.627478 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1073073a-e669-4957-a8f3-0332d51da37d tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:09.628268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1073073a-e669-4957-a8f3-0332d51da37d tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:09.629239 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1073073a-e669-4957-a8f3-0332d51da37d tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:09.629963 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1073073a-e669-4957-a8f3-0332d51da37d tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:09.630627 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1073073a-e669-4957-a8f3-0332d51da37d tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:09.729588 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1073073a-e669-4957-a8f3-0332d51da37d tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:09.740321 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1073073a-e669-4957-a8f3-0332d51da37d tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1136 microversion: 2.1 time: 0.127418 Sep 05 12:26:09.740900 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 307/617] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:09 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1136 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:09.799809 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7c2c3ac2-2ed1-46cf-a119-ac1dc0bfa2aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:09.800528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7c2c3ac2-2ed1-46cf-a119-ac1dc0bfa2aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:09.809905 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7c2c3ac2-2ed1-46cf-a119-ac1dc0bfa2aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:09.810540 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7c2c3ac2-2ed1-46cf-a119-ac1dc0bfa2aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:09.810983 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7c2c3ac2-2ed1-46cf-a119-ac1dc0bfa2aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:09.811828 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7c2c3ac2-2ed1-46cf-a119-ac1dc0bfa2aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:09.812294 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7c2c3ac2-2ed1-46cf-a119-ac1dc0bfa2aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:09.812858 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7c2c3ac2-2ed1-46cf-a119-ac1dc0bfa2aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:10.031073 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7c2c3ac2-2ed1-46cf-a119-ac1dc0bfa2aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:10.039967 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7c2c3ac2-2ed1-46cf-a119-ac1dc0bfa2aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1734 microversion: 2.1 time: 0.245842 Sep 05 12:26:10.040559 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 311/618] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:09 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1734 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:26:10.451670 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4299c566-c4c5-481a-83f2-42c29b428437 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:10.452307 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4299c566-c4c5-481a-83f2-42c29b428437 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:10.458343 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4299c566-c4c5-481a-83f2-42c29b428437 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:10.458825 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4299c566-c4c5-481a-83f2-42c29b428437 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:10.459259 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4299c566-c4c5-481a-83f2-42c29b428437 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:10.459986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4299c566-c4c5-481a-83f2-42c29b428437 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:10.460443 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4299c566-c4c5-481a-83f2-42c29b428437 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:10.460872 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4299c566-c4c5-481a-83f2-42c29b428437 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:10.626687 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4299c566-c4c5-481a-83f2-42c29b428437 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:10.634647 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4299c566-c4c5-481a-83f2-42c29b428437 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1664 microversion: 2.1 time: 0.186936 Sep 05 12:26:10.635152 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 308/619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:10 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1664 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:10.764427 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d5def71d-55b7-40da-8bff-6bd3e3ede00f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:10.765069 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d5def71d-55b7-40da-8bff-6bd3e3ede00f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:10.771324 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d5def71d-55b7-40da-8bff-6bd3e3ede00f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:10.771842 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d5def71d-55b7-40da-8bff-6bd3e3ede00f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:10.772281 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d5def71d-55b7-40da-8bff-6bd3e3ede00f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:10.772981 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d5def71d-55b7-40da-8bff-6bd3e3ede00f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:10.773443 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d5def71d-55b7-40da-8bff-6bd3e3ede00f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:10.773869 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d5def71d-55b7-40da-8bff-6bd3e3ede00f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:10.839432 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d5def71d-55b7-40da-8bff-6bd3e3ede00f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:10.848501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d5def71d-55b7-40da-8bff-6bd3e3ede00f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1192 microversion: 2.1 time: 0.087859 Sep 05 12:26:10.849713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 312/620] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:10 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:11.065748 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b1cd7bf1-af11-486b-a19d-a1ffddcc4188 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:11.065748 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b1cd7bf1-af11-486b-a19d-a1ffddcc4188 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:11.072914 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1cd7bf1-af11-486b-a19d-a1ffddcc4188 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:11.073628 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1cd7bf1-af11-486b-a19d-a1ffddcc4188 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:11.074041 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1cd7bf1-af11-486b-a19d-a1ffddcc4188 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:11.074757 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1cd7bf1-af11-486b-a19d-a1ffddcc4188 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:11.075315 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1cd7bf1-af11-486b-a19d-a1ffddcc4188 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:11.075846 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1cd7bf1-af11-486b-a19d-a1ffddcc4188 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:11.561696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b1cd7bf1-af11-486b-a19d-a1ffddcc4188 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:11.571026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b1cd7bf1-af11-486b-a19d-a1ffddcc4188 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1714 microversion: 2.1 time: 0.510264 Sep 05 12:26:11.571642 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 309/621] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:11 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1714 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:26:11.638089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-dda804e9-0cc5-48ab-8d90-d58d169ecd3a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:11.638590 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-dda804e9-0cc5-48ab-8d90-d58d169ecd3a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:11.640619 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:11.647252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dda804e9-0cc5-48ab-8d90-d58d169ecd3a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:11.647884 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dda804e9-0cc5-48ab-8d90-d58d169ecd3a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:11.648332 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dda804e9-0cc5-48ab-8d90-d58d169ecd3a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:11.649172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dda804e9-0cc5-48ab-8d90-d58d169ecd3a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:11.649827 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dda804e9-0cc5-48ab-8d90-d58d169ecd3a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:11.650258 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dda804e9-0cc5-48ab-8d90-d58d169ecd3a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:11.659269 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-551c3402-af55-4f77-a35a-bcda9565190b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:11.659269 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-551c3402-af55-4f77-a35a-bcda9565190b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:11.665597 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-551c3402-af55-4f77-a35a-bcda9565190b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:11.666087 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-551c3402-af55-4f77-a35a-bcda9565190b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:11.666520 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-551c3402-af55-4f77-a35a-bcda9565190b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:11.667221 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-551c3402-af55-4f77-a35a-bcda9565190b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:11.667730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-551c3402-af55-4f77-a35a-bcda9565190b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:11.668156 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-551c3402-af55-4f77-a35a-bcda9565190b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:11.744288 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-dda804e9-0cc5-48ab-8d90-d58d169ecd3a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] HTTP exception thrown: Cannot 'detach_volume' instance f64534ca-02f1-4369-94ac-1b50a063b870 while it is in vm_state rescued Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-dda804e9-0cc5-48ab-8d90-d58d169ecd3a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Request method failure captured: Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: DELETE /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-volume_attachments/300fc6ef-2603-4e6c-9b2c-9a7874cc32c2 HTTP/1.1 Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFemrRjsZ90kVZGEYqus02Ie2QEuWipxU6VktRw18WSg3Fpgy9K9kJquxI27KqHdB07zJsep0zf_MlmvFbu20x7ARqbxgkdDrmFUuOBlSs7bfiiMuDgXotQH7Nd3_qhrMVZfo6sO74REUpDPYIGAv4U70gu44RmLra0MEy0GinSKViEY Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 938f765828c545a8840a6983bc5d9e6d Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:26:11.745929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:26:11.747439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_938f765828c545a8840a6983bc5d9e6d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/938f765828c545a8840a6983bc5d9e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/938f765828c545a8840a6983bc5d9e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/938f765828c545a8840a6983bc5d9e6d"}]}] Sep 05 12:26:11.747439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:26:11.747439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 938f765828c545a8840a6983bc5d9e6d Sep 05 12:26:11.747439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:26:11.747439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-ServerRescueNegativeTestJSON-798904028-project Sep 05 12:26:11.747439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:26:11.747439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:26:11.747439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: ff0999bd21bf4db5981053922200be2a Sep 05 12:26:11.747439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-ServerRescueNegativeTestJSON-798904028-project Sep 05 12:26:11.747439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:26:11.747439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Cannot 'detach_volume' instance f64534ca-02f1-4369-94ac-1b50a063b870 while it is in vm_state rescued Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'server_id': 'f64534ca-02f1-4369-94ac-1b50a063b870', 'id': '300fc6ef-2603-4e6c-9b2c-9a7874cc32c2'} Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f64534ca-02f1-4369-94ac-1b50a063b870 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:26:11.748358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f64534ca-02f1-4369-94ac-1b50a063b870 while it is in vm_state rescued Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f64534ca-02f1-4369-94ac-1b50a063b870 while it is in vm_state rescued Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:26:11.749959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-dda804e9-0cc5-48ab-8d90-d58d169ecd3a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Returning 409 to user: Cannot 'detach_volume' instance f64534ca-02f1-4369-94ac-1b50a063b870 while it is in vm_state rescued {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:26:11.751499 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-dda804e9-0cc5-48ab-8d90-d58d169ecd3a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-volume_attachments/300fc6ef-2603-4e6c-9b2c-9a7874cc32c2" status: 409 len: 152 microversion: 2.1 time: 0.113437 Sep 05 12:26:11.751836 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 313/622] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Sep 5 12:26:11 2022] DELETE /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-volume_attachments/300fc6ef-2603-4e6c-9b2c-9a7874cc32c2 => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 05 12:26:11.757749 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f1d6cab8-8dd9-4ce4-95d7-a53104a5bf96 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:26:11.758289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f1d6cab8-8dd9-4ce4-95d7-a53104a5bf96 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:11.766793 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f1d6cab8-8dd9-4ce4-95d7-a53104a5bf96 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:11.767327 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f1d6cab8-8dd9-4ce4-95d7-a53104a5bf96 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:11.767795 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f1d6cab8-8dd9-4ce4-95d7-a53104a5bf96 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:11.768554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f1d6cab8-8dd9-4ce4-95d7-a53104a5bf96 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:11.769021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f1d6cab8-8dd9-4ce4-95d7-a53104a5bf96 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:11.769449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f1d6cab8-8dd9-4ce4-95d7-a53104a5bf96 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:11.845016 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f1d6cab8-8dd9-4ce4-95d7-a53104a5bf96 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "POST /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/action" status: 202 len: 0 microversion: 2.1 time: 0.091105 Sep 05 12:26:11.847716 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 314/623] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Sep 5 12:26:11 2022] POST /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:26:11.856064 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2330df3d-555d-4b8f-879b-73b54187a070 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:11.857642 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2330df3d-555d-4b8f-879b-73b54187a070 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:11.863687 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2330df3d-555d-4b8f-879b-73b54187a070 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:11.864182 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2330df3d-555d-4b8f-879b-73b54187a070 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:11.864621 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2330df3d-555d-4b8f-879b-73b54187a070 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:11.865350 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2330df3d-555d-4b8f-879b-73b54187a070 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:11.865807 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2330df3d-555d-4b8f-879b-73b54187a070 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:11.866233 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2330df3d-555d-4b8f-879b-73b54187a070 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:11.930348 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-551c3402-af55-4f77-a35a-bcda9565190b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:11.940990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-551c3402-af55-4f77-a35a-bcda9565190b tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1664 microversion: 2.1 time: 0.286887 Sep 05 12:26:11.942332 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 310/624] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:11 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1664 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:26:11.948704 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b826e36d-2224-4b93-90c3-4248b8c73268 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:11.950667 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b826e36d-2224-4b93-90c3-4248b8c73268 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:11.961201 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b826e36d-2224-4b93-90c3-4248b8c73268 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:11.962007 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b826e36d-2224-4b93-90c3-4248b8c73268 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:11.962757 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b826e36d-2224-4b93-90c3-4248b8c73268 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:11.963687 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b826e36d-2224-4b93-90c3-4248b8c73268 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:11.964302 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b826e36d-2224-4b93-90c3-4248b8c73268 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:11.965446 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b826e36d-2224-4b93-90c3-4248b8c73268 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:12.025452 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2330df3d-555d-4b8f-879b-73b54187a070 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:12.035199 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2330df3d-555d-4b8f-879b-73b54187a070 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1722 microversion: 2.1 time: 0.184754 Sep 05 12:26:12.035810 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 315/625] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:11 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:12.047569 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b826e36d-2224-4b93-90c3-4248b8c73268 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:12.055572 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b826e36d-2224-4b93-90c3-4248b8c73268 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1210 microversion: 2.1 time: 0.112053 Sep 05 12:26:12.056157 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 311/626] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:11 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:12.966140 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9ccb32b2-5c7d-498e-a364-23aaa340da28 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:12.967027 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9ccb32b2-5c7d-498e-a364-23aaa340da28 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:12.974128 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9ccb32b2-5c7d-498e-a364-23aaa340da28 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:12.974618 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9ccb32b2-5c7d-498e-a364-23aaa340da28 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:12.975059 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9ccb32b2-5c7d-498e-a364-23aaa340da28 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:12.976113 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9ccb32b2-5c7d-498e-a364-23aaa340da28 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:12.976476 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9ccb32b2-5c7d-498e-a364-23aaa340da28 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:12.976971 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9ccb32b2-5c7d-498e-a364-23aaa340da28 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:13.058770 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d2eb1927-1ead-4942-8394-97c0cb701bd8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:13.059589 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d2eb1927-1ead-4942-8394-97c0cb701bd8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:13.067652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2eb1927-1ead-4942-8394-97c0cb701bd8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:13.068158 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2eb1927-1ead-4942-8394-97c0cb701bd8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:13.068746 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2eb1927-1ead-4942-8394-97c0cb701bd8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:13.069462 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2eb1927-1ead-4942-8394-97c0cb701bd8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:13.069921 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2eb1927-1ead-4942-8394-97c0cb701bd8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:13.070352 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2eb1927-1ead-4942-8394-97c0cb701bd8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:13.126876 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9ccb32b2-5c7d-498e-a364-23aaa340da28 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:13.136614 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9ccb32b2-5c7d-498e-a364-23aaa340da28 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1668 microversion: 2.1 time: 0.174432 Sep 05 12:26:13.137312 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 316/627] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:12 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1668 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:13.142382 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0e8a8f1d-bbac-4c19-aff5-a66cc5c89d30 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:13.143413 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0e8a8f1d-bbac-4c19-aff5-a66cc5c89d30 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:13.151065 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0e8a8f1d-bbac-4c19-aff5-a66cc5c89d30 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:13.152197 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0e8a8f1d-bbac-4c19-aff5-a66cc5c89d30 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:13.152981 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0e8a8f1d-bbac-4c19-aff5-a66cc5c89d30 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:13.154706 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0e8a8f1d-bbac-4c19-aff5-a66cc5c89d30 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:13.155858 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0e8a8f1d-bbac-4c19-aff5-a66cc5c89d30 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:13.157135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0e8a8f1d-bbac-4c19-aff5-a66cc5c89d30 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:13.297772 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d2eb1927-1ead-4942-8394-97c0cb701bd8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:13.307466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d2eb1927-1ead-4942-8394-97c0cb701bd8 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1722 microversion: 2.1 time: 0.252909 Sep 05 12:26:13.308671 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 312/628] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:13 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:26:13.333009 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0e8a8f1d-bbac-4c19-aff5-a66cc5c89d30 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:13.341921 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0e8a8f1d-bbac-4c19-aff5-a66cc5c89d30 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.203391 Sep 05 12:26:13.351588 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 317/629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:13 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:13.351836 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-8077863e-f17b-4e36-9e0f-ed802ed62a87 req-499b7bfa-08d2-473a-9c91-fb70f45e1b85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43404b9f-c23c-44b3-ba61-4420d1497d4f", "tag": "081037e4-4e81-44a8-91d2-503e4a14938d"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:26:13.358827 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-8077863e-f17b-4e36-9e0f-ed802ed62a87 req-499b7bfa-08d2-473a-9c91-fb70f45e1b85 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:13.359320 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-8077863e-f17b-4e36-9e0f-ed802ed62a87 req-499b7bfa-08d2-473a-9c91-fb70f45e1b85 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:13.359924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-8077863e-f17b-4e36-9e0f-ed802ed62a87 req-499b7bfa-08d2-473a-9c91-fb70f45e1b85 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:13.374204 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-8077863e-f17b-4e36-9e0f-ed802ed62a87 req-499b7bfa-08d2-473a-9c91-fb70f45e1b85 service nova] Creating event network-changed:081037e4-4e81-44a8-91d2-503e4a14938d for instance 43404b9f-c23c-44b3-ba61-4420d1497d4f on hv-cinder-85518 Sep 05 12:26:13.379808 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-8077863e-f17b-4e36-9e0f-ed802ed62a87 req-499b7bfa-08d2-473a-9c91-fb70f45e1b85 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034401 Sep 05 12:26:13.380598 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 313/630] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:26:14.334195 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f49fa829-2d09-4b18-a2e3-caa55e93e00f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:14.334857 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f49fa829-2d09-4b18-a2e3-caa55e93e00f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:14.341965 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f49fa829-2d09-4b18-a2e3-caa55e93e00f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:14.342450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f49fa829-2d09-4b18-a2e3-caa55e93e00f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:14.342887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f49fa829-2d09-4b18-a2e3-caa55e93e00f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:14.343640 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f49fa829-2d09-4b18-a2e3-caa55e93e00f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:14.344604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f49fa829-2d09-4b18-a2e3-caa55e93e00f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:14.345031 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f49fa829-2d09-4b18-a2e3-caa55e93e00f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:14.370066 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-585aa4ac-d183-41a5-bc94-df06e9610b68 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:14.371169 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-585aa4ac-d183-41a5-bc94-df06e9610b68 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:14.382267 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-585aa4ac-d183-41a5-bc94-df06e9610b68 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:14.383229 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-585aa4ac-d183-41a5-bc94-df06e9610b68 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:14.384458 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-585aa4ac-d183-41a5-bc94-df06e9610b68 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:14.386062 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-585aa4ac-d183-41a5-bc94-df06e9610b68 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:14.386913 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-585aa4ac-d183-41a5-bc94-df06e9610b68 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:14.387714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-585aa4ac-d183-41a5-bc94-df06e9610b68 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:14.502300 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f49fa829-2d09-4b18-a2e3-caa55e93e00f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:14.512123 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f49fa829-2d09-4b18-a2e3-caa55e93e00f tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1722 microversion: 2.1 time: 0.183559 Sep 05 12:26:14.513021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 318/631] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:14 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:14.557301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-585aa4ac-d183-41a5-bc94-df06e9610b68 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:14.565601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-585aa4ac-d183-41a5-bc94-df06e9610b68 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.202052 Sep 05 12:26:14.566202 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 314/632] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:14 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:26:15.535658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-bfe77cd4-8be4-4b39-982f-897fac29e41e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:15.536249 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-bfe77cd4-8be4-4b39-982f-897fac29e41e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:15.542822 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bfe77cd4-8be4-4b39-982f-897fac29e41e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:15.543299 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bfe77cd4-8be4-4b39-982f-897fac29e41e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:15.543759 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bfe77cd4-8be4-4b39-982f-897fac29e41e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:15.544458 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bfe77cd4-8be4-4b39-982f-897fac29e41e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:15.544909 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bfe77cd4-8be4-4b39-982f-897fac29e41e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:15.545335 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bfe77cd4-8be4-4b39-982f-897fac29e41e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:15.587810 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8eb9f73c-6fe8-4879-8bf0-599d5f8eb8c6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:15.588499 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8eb9f73c-6fe8-4879-8bf0-599d5f8eb8c6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:15.595229 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8eb9f73c-6fe8-4879-8bf0-599d5f8eb8c6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:15.595763 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8eb9f73c-6fe8-4879-8bf0-599d5f8eb8c6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:15.596443 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8eb9f73c-6fe8-4879-8bf0-599d5f8eb8c6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:15.597287 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8eb9f73c-6fe8-4879-8bf0-599d5f8eb8c6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:15.597794 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8eb9f73c-6fe8-4879-8bf0-599d5f8eb8c6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:15.598527 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8eb9f73c-6fe8-4879-8bf0-599d5f8eb8c6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:15.690953 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-bfe77cd4-8be4-4b39-982f-897fac29e41e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:15.700387 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-bfe77cd4-8be4-4b39-982f-897fac29e41e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1722 microversion: 2.1 time: 0.168545 Sep 05 12:26:15.700971 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 319/633] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:15 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:15.747558 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8eb9f73c-6fe8-4879-8bf0-599d5f8eb8c6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:15.755834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8eb9f73c-6fe8-4879-8bf0-599d5f8eb8c6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.172025 Sep 05 12:26:15.756397 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 315/634] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:15 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:26:16.724487 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1fba47b0-3d97-4282-acfe-b32612ad6c79 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:16.725108 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1fba47b0-3d97-4282-acfe-b32612ad6c79 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:16.731727 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1fba47b0-3d97-4282-acfe-b32612ad6c79 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:16.732208 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1fba47b0-3d97-4282-acfe-b32612ad6c79 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:16.732642 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1fba47b0-3d97-4282-acfe-b32612ad6c79 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:16.733343 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1fba47b0-3d97-4282-acfe-b32612ad6c79 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:16.733794 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1fba47b0-3d97-4282-acfe-b32612ad6c79 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:16.734216 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1fba47b0-3d97-4282-acfe-b32612ad6c79 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:16.778724 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8e68e95b-1d5b-4380-a5a7-695f77f1fdd8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:16.779313 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8e68e95b-1d5b-4380-a5a7-695f77f1fdd8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:16.786404 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e68e95b-1d5b-4380-a5a7-695f77f1fdd8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:16.786859 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e68e95b-1d5b-4380-a5a7-695f77f1fdd8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:16.787324 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e68e95b-1d5b-4380-a5a7-695f77f1fdd8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:16.788065 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e68e95b-1d5b-4380-a5a7-695f77f1fdd8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:16.788526 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e68e95b-1d5b-4380-a5a7-695f77f1fdd8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:16.788989 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8e68e95b-1d5b-4380-a5a7-695f77f1fdd8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:16.875947 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1fba47b0-3d97-4282-acfe-b32612ad6c79 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:16.885010 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1fba47b0-3d97-4282-acfe-b32612ad6c79 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1728 microversion: 2.1 time: 0.164402 Sep 05 12:26:16.885791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 320/635] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:16 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:16.910615 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-fd537344-3eca-430c-b840-770258b9a916 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:16.911413 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-fd537344-3eca-430c-b840-770258b9a916 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:16.917891 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fd537344-3eca-430c-b840-770258b9a916 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:16.918178 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fd537344-3eca-430c-b840-770258b9a916 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:16.918609 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fd537344-3eca-430c-b840-770258b9a916 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:16.919320 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fd537344-3eca-430c-b840-770258b9a916 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:16.919805 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fd537344-3eca-430c-b840-770258b9a916 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:16.920236 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fd537344-3eca-430c-b840-770258b9a916 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:16.941193 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8e68e95b-1d5b-4380-a5a7-695f77f1fdd8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:16.949291 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8e68e95b-1d5b-4380-a5a7-695f77f1fdd8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.174548 Sep 05 12:26:16.950042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 316/636] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:16 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:26:17.008351 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-fd537344-3eca-430c-b840-770258b9a916 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101709 Sep 05 12:26:17.008976 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 321/637] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Sep 5 12:26:16 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:26:17.912788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-a3ec6a65-360c-421c-b359-682bb0a24746 req-9ffecf83-6621-40a1-af13-6517de3ddc65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64534ca-02f1-4369-94ac-1b50a063b870", "tag": "6949e5c9-4d88-4c61-a9fc-3ae9edcff7ae"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:26:17.918490 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:17.924724 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-a3ec6a65-360c-421c-b359-682bb0a24746 req-9ffecf83-6621-40a1-af13-6517de3ddc65 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:17.925346 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-a3ec6a65-360c-421c-b359-682bb0a24746 req-9ffecf83-6621-40a1-af13-6517de3ddc65 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:17.926067 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-a3ec6a65-360c-421c-b359-682bb0a24746 req-9ffecf83-6621-40a1-af13-6517de3ddc65 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:17.940947 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-a3ec6a65-360c-421c-b359-682bb0a24746 req-9ffecf83-6621-40a1-af13-6517de3ddc65 service nova] Creating event network-changed:6949e5c9-4d88-4c61-a9fc-3ae9edcff7ae for instance f64534ca-02f1-4369-94ac-1b50a063b870 on hv-cinder-85518 Sep 05 12:26:17.947451 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-a3ec6a65-360c-421c-b359-682bb0a24746 req-9ffecf83-6621-40a1-af13-6517de3ddc65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040502 Sep 05 12:26:17.948094 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 317/638] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:26:17.973668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1bb89e9c-08d1-48ee-8b78-10be1fb97122 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:17.974279 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1bb89e9c-08d1-48ee-8b78-10be1fb97122 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:17.982086 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1bb89e9c-08d1-48ee-8b78-10be1fb97122 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:17.982647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1bb89e9c-08d1-48ee-8b78-10be1fb97122 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:17.983008 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1bb89e9c-08d1-48ee-8b78-10be1fb97122 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:17.983765 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1bb89e9c-08d1-48ee-8b78-10be1fb97122 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:17.984214 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1bb89e9c-08d1-48ee-8b78-10be1fb97122 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:17.984693 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1bb89e9c-08d1-48ee-8b78-10be1fb97122 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:18.145511 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1bb89e9c-08d1-48ee-8b78-10be1fb97122 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:18.154501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1bb89e9c-08d1-48ee-8b78-10be1fb97122 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.185821 Sep 05 12:26:18.155139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 322/639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:17 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:19.178828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:19.179783 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=6 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:19.184805 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8a6e12e3-6799-48fe-861d-2ea53f9fb682 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:19.185522 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8a6e12e3-6799-48fe-861d-2ea53f9fb682 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:19.193058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a6e12e3-6799-48fe-861d-2ea53f9fb682 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:19.193627 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a6e12e3-6799-48fe-861d-2ea53f9fb682 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:19.194193 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a6e12e3-6799-48fe-861d-2ea53f9fb682 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:19.194931 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a6e12e3-6799-48fe-861d-2ea53f9fb682 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:19.195458 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a6e12e3-6799-48fe-861d-2ea53f9fb682 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:19.195946 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a6e12e3-6799-48fe-861d-2ea53f9fb682 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:19.339024 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8a6e12e3-6799-48fe-861d-2ea53f9fb682 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:19.349636 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8a6e12e3-6799-48fe-861d-2ea53f9fb682 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.171323 Sep 05 12:26:19.350340 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 318/640] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:19 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:19.967447 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-f2d26d5e-9357-4cab-923d-eba20db1b7e4 req-33f81b7e-aaa7-4846-868e-4537be67c5cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64534ca-02f1-4369-94ac-1b50a063b870", "tag": "6949e5c9-4d88-4c61-a9fc-3ae9edcff7ae"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:26:19.973902 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:19.981370 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-f2d26d5e-9357-4cab-923d-eba20db1b7e4 req-33f81b7e-aaa7-4846-868e-4537be67c5cc service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:19.981849 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-f2d26d5e-9357-4cab-923d-eba20db1b7e4 req-33f81b7e-aaa7-4846-868e-4537be67c5cc service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:19.982395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-f2d26d5e-9357-4cab-923d-eba20db1b7e4 req-33f81b7e-aaa7-4846-868e-4537be67c5cc service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:19.994090 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-f2d26d5e-9357-4cab-923d-eba20db1b7e4 req-33f81b7e-aaa7-4846-868e-4537be67c5cc service nova] Creating event network-changed:6949e5c9-4d88-4c61-a9fc-3ae9edcff7ae for instance f64534ca-02f1-4369-94ac-1b50a063b870 on hv-cinder-85518 Sep 05 12:26:19.999170 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-f2d26d5e-9357-4cab-923d-eba20db1b7e4 req-33f81b7e-aaa7-4846-868e-4537be67c5cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035381 Sep 05 12:26:20.000770 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 323/641] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:26:20.373795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-579e46b7-4e53-4a72-bd36-f42bb8aadb6b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:20.374257 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-579e46b7-4e53-4a72-bd36-f42bb8aadb6b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:20.380939 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-579e46b7-4e53-4a72-bd36-f42bb8aadb6b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:20.381411 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-579e46b7-4e53-4a72-bd36-f42bb8aadb6b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:20.381841 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-579e46b7-4e53-4a72-bd36-f42bb8aadb6b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:20.382536 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-579e46b7-4e53-4a72-bd36-f42bb8aadb6b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:20.382993 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-579e46b7-4e53-4a72-bd36-f42bb8aadb6b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:20.383411 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-579e46b7-4e53-4a72-bd36-f42bb8aadb6b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:20.866588 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-579e46b7-4e53-4a72-bd36-f42bb8aadb6b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:20.874764 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-579e46b7-4e53-4a72-bd36-f42bb8aadb6b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.504879 Sep 05 12:26:20.875389 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 319/642] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:20 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:21.898413 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d3edbc21-8542-495c-9554-91d46751658e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:21.899113 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d3edbc21-8542-495c-9554-91d46751658e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:21.906474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d3edbc21-8542-495c-9554-91d46751658e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:21.906962 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d3edbc21-8542-495c-9554-91d46751658e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:21.907404 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d3edbc21-8542-495c-9554-91d46751658e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:21.908136 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d3edbc21-8542-495c-9554-91d46751658e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:21.908591 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d3edbc21-8542-495c-9554-91d46751658e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:21.909014 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d3edbc21-8542-495c-9554-91d46751658e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:22.049666 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d3edbc21-8542-495c-9554-91d46751658e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:22.057843 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d3edbc21-8542-495c-9554-91d46751658e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.163534 Sep 05 12:26:22.058439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 324/643] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:21 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:23.082760 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5c1ba6ce-255d-4589-9d4e-3706cd337ff5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:23.083365 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5c1ba6ce-255d-4589-9d4e-3706cd337ff5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:23.090648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c1ba6ce-255d-4589-9d4e-3706cd337ff5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:23.091205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c1ba6ce-255d-4589-9d4e-3706cd337ff5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:23.091680 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c1ba6ce-255d-4589-9d4e-3706cd337ff5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:23.092405 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c1ba6ce-255d-4589-9d4e-3706cd337ff5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:23.092884 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c1ba6ce-255d-4589-9d4e-3706cd337ff5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:23.093288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c1ba6ce-255d-4589-9d4e-3706cd337ff5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:23.235825 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5c1ba6ce-255d-4589-9d4e-3706cd337ff5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:23.244326 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5c1ba6ce-255d-4589-9d4e-3706cd337ff5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.165990 Sep 05 12:26:23.245214 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 320/644] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:23 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:24.269642 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7a274469-a223-44e6-b6f0-d9fb91485e49 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:24.270271 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7a274469-a223-44e6-b6f0-d9fb91485e49 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:24.277488 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7a274469-a223-44e6-b6f0-d9fb91485e49 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:24.278074 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7a274469-a223-44e6-b6f0-d9fb91485e49 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:24.278593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7a274469-a223-44e6-b6f0-d9fb91485e49 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:24.279411 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7a274469-a223-44e6-b6f0-d9fb91485e49 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:24.280005 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7a274469-a223-44e6-b6f0-d9fb91485e49 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:24.280615 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7a274469-a223-44e6-b6f0-d9fb91485e49 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:24.417041 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7a274469-a223-44e6-b6f0-d9fb91485e49 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:24.426111 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7a274469-a223-44e6-b6f0-d9fb91485e49 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.160966 Sep 05 12:26:24.426698 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 325/645] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:24 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:25.450084 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ef560f70-01ca-4ed9-baa4-d6adbbe57afb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:25.450702 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ef560f70-01ca-4ed9-baa4-d6adbbe57afb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:25.457336 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef560f70-01ca-4ed9-baa4-d6adbbe57afb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:25.457820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef560f70-01ca-4ed9-baa4-d6adbbe57afb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:25.458262 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef560f70-01ca-4ed9-baa4-d6adbbe57afb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:25.458958 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef560f70-01ca-4ed9-baa4-d6adbbe57afb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:25.459414 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef560f70-01ca-4ed9-baa4-d6adbbe57afb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:25.459869 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef560f70-01ca-4ed9-baa4-d6adbbe57afb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:25.603820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ef560f70-01ca-4ed9-baa4-d6adbbe57afb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:25.611719 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ef560f70-01ca-4ed9-baa4-d6adbbe57afb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.165616 Sep 05 12:26:25.612298 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 321/646] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:25 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:26.633633 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4306b816-dff9-44e7-8c5d-a84ca46d49af tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:26.634194 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4306b816-dff9-44e7-8c5d-a84ca46d49af tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:26.640676 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4306b816-dff9-44e7-8c5d-a84ca46d49af tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:26.641167 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4306b816-dff9-44e7-8c5d-a84ca46d49af tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:26.641614 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4306b816-dff9-44e7-8c5d-a84ca46d49af tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:26.642327 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4306b816-dff9-44e7-8c5d-a84ca46d49af tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:26.642789 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4306b816-dff9-44e7-8c5d-a84ca46d49af tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:26.643224 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4306b816-dff9-44e7-8c5d-a84ca46d49af tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:26.787444 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4306b816-dff9-44e7-8c5d-a84ca46d49af tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:26.795498 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4306b816-dff9-44e7-8c5d-a84ca46d49af tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.165765 Sep 05 12:26:26.796123 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 326/647] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:26 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:27.819514 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d20ad6b8-aeae-4cdc-a0a9-cece32b36a07 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:27.820264 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d20ad6b8-aeae-4cdc-a0a9-cece32b36a07 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:27.827302 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d20ad6b8-aeae-4cdc-a0a9-cece32b36a07 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:27.827842 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d20ad6b8-aeae-4cdc-a0a9-cece32b36a07 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:27.828305 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d20ad6b8-aeae-4cdc-a0a9-cece32b36a07 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:27.829020 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d20ad6b8-aeae-4cdc-a0a9-cece32b36a07 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:27.829475 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d20ad6b8-aeae-4cdc-a0a9-cece32b36a07 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:27.829901 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d20ad6b8-aeae-4cdc-a0a9-cece32b36a07 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:27.965001 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d20ad6b8-aeae-4cdc-a0a9-cece32b36a07 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:27.968457 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:27.974552 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d20ad6b8-aeae-4cdc-a0a9-cece32b36a07 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.159336 Sep 05 12:26:27.975145 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 322/648] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:27 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:26:28.998517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ca835666-64f1-4e86-841a-4779a9061750 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:28.999135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ca835666-64f1-4e86-841a-4779a9061750 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:29.006549 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca835666-64f1-4e86-841a-4779a9061750 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:29.006663 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca835666-64f1-4e86-841a-4779a9061750 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:29.007037 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca835666-64f1-4e86-841a-4779a9061750 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:29.007758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca835666-64f1-4e86-841a-4779a9061750 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:29.008213 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca835666-64f1-4e86-841a-4779a9061750 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:29.008885 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca835666-64f1-4e86-841a-4779a9061750 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:29.029742 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:29.148524 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ca835666-64f1-4e86-841a-4779a9061750 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:29.157459 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ca835666-64f1-4e86-841a-4779a9061750 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.162940 Sep 05 12:26:29.158043 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 327/649] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:28 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:29.259585 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-6e7ff674-d0d8-4539-869c-c6b91a00fd7e req-c8d6210c-d09d-4fb0-8344-b5a750d447c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43404b9f-c23c-44b3-ba61-4420d1497d4f", "name": "network-vif-plugged", "status": "completed", "tag": "081037e4-4e81-44a8-91d2-503e4a14938d"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:26:29.270232 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-6e7ff674-d0d8-4539-869c-c6b91a00fd7e req-c8d6210c-d09d-4fb0-8344-b5a750d447c9 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:29.271174 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-6e7ff674-d0d8-4539-869c-c6b91a00fd7e req-c8d6210c-d09d-4fb0-8344-b5a750d447c9 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:29.271764 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-6e7ff674-d0d8-4539-869c-c6b91a00fd7e req-c8d6210c-d09d-4fb0-8344-b5a750d447c9 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:29.285919 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-6e7ff674-d0d8-4539-869c-c6b91a00fd7e req-c8d6210c-d09d-4fb0-8344-b5a750d447c9 service nova] Creating event network-vif-plugged:081037e4-4e81-44a8-91d2-503e4a14938d for instance 43404b9f-c23c-44b3-ba61-4420d1497d4f on hv-cinder-85518 Sep 05 12:26:29.290923 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-6e7ff674-d0d8-4539-869c-c6b91a00fd7e req-c8d6210c-d09d-4fb0-8344-b5a750d447c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035394 Sep 05 12:26:29.291583 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 323/650] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:26:30.180866 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-17fb43f1-b878-4a3f-b40d-3d8b8b1062e9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:30.181487 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-17fb43f1-b878-4a3f-b40d-3d8b8b1062e9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:30.188808 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-17fb43f1-b878-4a3f-b40d-3d8b8b1062e9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:30.189415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-17fb43f1-b878-4a3f-b40d-3d8b8b1062e9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:30.189743 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-17fb43f1-b878-4a3f-b40d-3d8b8b1062e9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:30.190481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-17fb43f1-b878-4a3f-b40d-3d8b8b1062e9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:30.190940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-17fb43f1-b878-4a3f-b40d-3d8b8b1062e9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:30.191371 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-17fb43f1-b878-4a3f-b40d-3d8b8b1062e9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:30.332022 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-17fb43f1-b878-4a3f-b40d-3d8b8b1062e9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:30.339905 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-17fb43f1-b878-4a3f-b40d-3d8b8b1062e9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.163031 Sep 05 12:26:30.340483 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 328/651] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:30 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:31.363862 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-39d3750e-2eb3-499c-83f2-a19598254eeb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:31.364558 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-39d3750e-2eb3-499c-83f2-a19598254eeb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:31.375667 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-39d3750e-2eb3-499c-83f2-a19598254eeb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:31.376415 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-39d3750e-2eb3-499c-83f2-a19598254eeb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:31.377226 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-39d3750e-2eb3-499c-83f2-a19598254eeb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:31.378384 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-39d3750e-2eb3-499c-83f2-a19598254eeb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:31.378852 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-39d3750e-2eb3-499c-83f2-a19598254eeb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:31.379572 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-39d3750e-2eb3-499c-83f2-a19598254eeb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:31.522528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-39d3750e-2eb3-499c-83f2-a19598254eeb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:31.530854 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-39d3750e-2eb3-499c-83f2-a19598254eeb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1264 microversion: 2.1 time: 0.171708 Sep 05 12:26:31.531468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 324/652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:31 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:31.663954 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-48af333b-1614-488a-bec5-a0c5ac63349f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:31.664475 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-48af333b-1614-488a-bec5-a0c5ac63349f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:31.670853 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-48af333b-1614-488a-bec5-a0c5ac63349f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:31.671333 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-48af333b-1614-488a-bec5-a0c5ac63349f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:31.672292 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-48af333b-1614-488a-bec5-a0c5ac63349f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:31.673014 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-48af333b-1614-488a-bec5-a0c5ac63349f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:31.673462 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-48af333b-1614-488a-bec5-a0c5ac63349f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:31.673912 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-48af333b-1614-488a-bec5-a0c5ac63349f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:31.708906 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-48af333b-1614-488a-bec5-a0c5ac63349f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/os-volume_attachments/5be5f278-c5f2-4f11-87a5-d1412749ed40" status: 200 len: 194 microversion: 2.20 time: 0.048827 Sep 05 12:26:31.709655 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 329/653] 10.222.0.16 () {60 vars in 1454 bytes} [Mon Sep 5 12:26:31 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/os-volume_attachments/5be5f278-c5f2-4f11-87a5-d1412749ed40 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 12:26:31.782919 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5c3a36f4-795e-42e4-8f03-3866776d4447 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:31.783404 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5c3a36f4-795e-42e4-8f03-3866776d4447 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:31.790047 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c3a36f4-795e-42e4-8f03-3866776d4447 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:31.790533 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c3a36f4-795e-42e4-8f03-3866776d4447 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:31.790970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c3a36f4-795e-42e4-8f03-3866776d4447 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:31.791788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c3a36f4-795e-42e4-8f03-3866776d4447 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:31.792245 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c3a36f4-795e-42e4-8f03-3866776d4447 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:31.792669 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c3a36f4-795e-42e4-8f03-3866776d4447 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:31.885588 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-5c3a36f4-795e-42e4-8f03-3866776d4447 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lazy-loading 'services' on Instance uuid 78cd9ae3-2a60-4905-a291-30169e41c86c {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:26:31.973692 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5c3a36f4-795e-42e4-8f03-3866776d4447 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/os-volume_attachments/5be5f278-c5f2-4f11-87a5-d1412749ed40" status: 202 len: 0 microversion: 2.20 time: 0.194548 Sep 05 12:26:31.974803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 325/654] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Sep 5 12:26:31 2022] DELETE /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/os-volume_attachments/5be5f278-c5f2-4f11-87a5-d1412749ed40 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:26:31.983903 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-231cdb37-9146-4706-a7a0-c0b276f360cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:31.986625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-231cdb37-9146-4706-a7a0-c0b276f360cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:31.993414 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-231cdb37-9146-4706-a7a0-c0b276f360cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:31.993923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-231cdb37-9146-4706-a7a0-c0b276f360cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:31.994368 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-231cdb37-9146-4706-a7a0-c0b276f360cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:31.995054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-231cdb37-9146-4706-a7a0-c0b276f360cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:31.995504 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-231cdb37-9146-4706-a7a0-c0b276f360cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:31.996002 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-231cdb37-9146-4706-a7a0-c0b276f360cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:32.026576 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-231cdb37-9146-4706-a7a0-c0b276f360cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047538 Sep 05 12:26:32.027396 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 330/655] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Sep 5 12:26:31 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:26:32.554673 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5b8385df-92f8-4a11-bded-ac5d5d54d5cc tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:32.555344 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5b8385df-92f8-4a11-bded-ac5d5d54d5cc tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:32.561653 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b8385df-92f8-4a11-bded-ac5d5d54d5cc tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:32.562129 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b8385df-92f8-4a11-bded-ac5d5d54d5cc tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:32.562623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b8385df-92f8-4a11-bded-ac5d5d54d5cc tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:32.563284 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b8385df-92f8-4a11-bded-ac5d5d54d5cc tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:32.563773 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b8385df-92f8-4a11-bded-ac5d5d54d5cc tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:32.564200 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b8385df-92f8-4a11-bded-ac5d5d54d5cc tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:32.704676 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5b8385df-92f8-4a11-bded-ac5d5d54d5cc tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:32.712897 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5b8385df-92f8-4a11-bded-ac5d5d54d5cc tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1451 microversion: 2.1 time: 0.162820 Sep 05 12:26:32.713480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 326/656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:32 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:32.736378 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1272d735-9312-4a50-9640-e0eaa5f3f25b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:32.737061 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1272d735-9312-4a50-9640-e0eaa5f3f25b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:32.745311 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1272d735-9312-4a50-9640-e0eaa5f3f25b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:32.745805 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1272d735-9312-4a50-9640-e0eaa5f3f25b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:32.746277 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1272d735-9312-4a50-9640-e0eaa5f3f25b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:32.747153 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1272d735-9312-4a50-9640-e0eaa5f3f25b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:32.747885 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1272d735-9312-4a50-9640-e0eaa5f3f25b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:32.748523 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1272d735-9312-4a50-9640-e0eaa5f3f25b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:32.905418 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1272d735-9312-4a50-9640-e0eaa5f3f25b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:32.913383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1272d735-9312-4a50-9640-e0eaa5f3f25b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1451 microversion: 2.1 time: 0.181007 Sep 05 12:26:32.913980 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 331/657] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:26:32 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1451 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:33.040778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e42851f7-8c3f-4ea7-b4d6-f954b93b9abe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:33.043150 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e42851f7-8c3f-4ea7-b4d6-f954b93b9abe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:33.053878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e42851f7-8c3f-4ea7-b4d6-f954b93b9abe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:33.055615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e42851f7-8c3f-4ea7-b4d6-f954b93b9abe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:33.057449 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e42851f7-8c3f-4ea7-b4d6-f954b93b9abe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:33.058632 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e42851f7-8c3f-4ea7-b4d6-f954b93b9abe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:33.059180 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e42851f7-8c3f-4ea7-b4d6-f954b93b9abe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:33.059566 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e42851f7-8c3f-4ea7-b4d6-f954b93b9abe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:33.103365 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e42851f7-8c3f-4ea7-b4d6-f954b93b9abe tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066609 Sep 05 12:26:33.104127 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 327/658] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Sep 5 12:26:33 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:26:34.117305 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-dbd59857-8065-41cd-95f0-d90faca5d9e6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:34.119782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-dbd59857-8065-41cd-95f0-d90faca5d9e6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:34.126950 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dbd59857-8065-41cd-95f0-d90faca5d9e6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:34.127445 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dbd59857-8065-41cd-95f0-d90faca5d9e6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:34.127934 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dbd59857-8065-41cd-95f0-d90faca5d9e6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:34.128646 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dbd59857-8065-41cd-95f0-d90faca5d9e6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:34.129096 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dbd59857-8065-41cd-95f0-d90faca5d9e6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:34.129523 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dbd59857-8065-41cd-95f0-d90faca5d9e6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:34.163053 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-dbd59857-8065-41cd-95f0-d90faca5d9e6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049958 Sep 05 12:26:34.164083 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 332/659] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Sep 5 12:26:34 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:26:34.239195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-00a8611f-f4b6-4f1e-8b8d-32da82b23e4b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:34.239988 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-00a8611f-f4b6-4f1e-8b8d-32da82b23e4b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:34.246942 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-00a8611f-f4b6-4f1e-8b8d-32da82b23e4b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:34.247514 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-00a8611f-f4b6-4f1e-8b8d-32da82b23e4b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:34.250704 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-00a8611f-f4b6-4f1e-8b8d-32da82b23e4b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:34.251982 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-00a8611f-f4b6-4f1e-8b8d-32da82b23e4b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:34.252449 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-00a8611f-f4b6-4f1e-8b8d-32da82b23e4b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:34.252873 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-00a8611f-f4b6-4f1e-8b8d-32da82b23e4b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:34.281465 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-00a8611f-f4b6-4f1e-8b8d-32da82b23e4b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Going to try to terminate instance {{(pid=120535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:26:34.374046 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-00a8611f-f4b6-4f1e-8b8d-32da82b23e4b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 204 len: 0 microversion: 2.20 time: 0.140596 Sep 05 12:26:34.374813 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 328/660] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Sep 5 12:26:34 2022] DELETE /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 05 12:26:34.385475 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-17fd6a66-da8a-44c8-aeb1-585a08c7894b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:34.386343 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-17fd6a66-da8a-44c8-aeb1-585a08c7894b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:34.393677 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-17fd6a66-da8a-44c8-aeb1-585a08c7894b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:34.394169 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-17fd6a66-da8a-44c8-aeb1-585a08c7894b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:34.394610 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-17fd6a66-da8a-44c8-aeb1-585a08c7894b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:34.395320 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-17fd6a66-da8a-44c8-aeb1-585a08c7894b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:34.395804 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-17fd6a66-da8a-44c8-aeb1-585a08c7894b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:34.396234 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-17fd6a66-da8a-44c8-aeb1-585a08c7894b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:34.550607 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-17fd6a66-da8a-44c8-aeb1-585a08c7894b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:34.559444 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-17fd6a66-da8a-44c8-aeb1-585a08c7894b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:34.560949 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-17fd6a66-da8a-44c8-aeb1-585a08c7894b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:34.562174 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-17fd6a66-da8a-44c8-aeb1-585a08c7894b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.181766 Sep 05 12:26:34.562725 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 333/661] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:34 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:34.733473 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-daede8bf-bc06-4541-bcce-fb8d61d8322a req-47be0335-38cb-466d-be03-9686e35e012d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43404b9f-c23c-44b3-ba61-4420d1497d4f", "tag": "081037e4-4e81-44a8-91d2-503e4a14938d"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:26:34.743411 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-daede8bf-bc06-4541-bcce-fb8d61d8322a req-47be0335-38cb-466d-be03-9686e35e012d service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:34.743824 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-daede8bf-bc06-4541-bcce-fb8d61d8322a req-47be0335-38cb-466d-be03-9686e35e012d service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:34.744248 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-daede8bf-bc06-4541-bcce-fb8d61d8322a req-47be0335-38cb-466d-be03-9686e35e012d service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:34.756907 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-daede8bf-bc06-4541-bcce-fb8d61d8322a req-47be0335-38cb-466d-be03-9686e35e012d service nova] Creating event network-changed:081037e4-4e81-44a8-91d2-503e4a14938d for instance 43404b9f-c23c-44b3-ba61-4420d1497d4f on hv-cinder-85518 Sep 05 12:26:34.762191 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-daede8bf-bc06-4541-bcce-fb8d61d8322a req-47be0335-38cb-466d-be03-9686e35e012d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032787 Sep 05 12:26:34.762780 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 329/662] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:26:35.589415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c215dcfe-88de-4546-ab9d-c064ecb257e2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:35.590165 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c215dcfe-88de-4546-ab9d-c064ecb257e2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:35.597066 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c215dcfe-88de-4546-ab9d-c064ecb257e2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:35.597547 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c215dcfe-88de-4546-ab9d-c064ecb257e2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:35.597979 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c215dcfe-88de-4546-ab9d-c064ecb257e2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:35.598677 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c215dcfe-88de-4546-ab9d-c064ecb257e2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:35.599127 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c215dcfe-88de-4546-ab9d-c064ecb257e2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:35.599575 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c215dcfe-88de-4546-ab9d-c064ecb257e2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:35.738746 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c215dcfe-88de-4546-ab9d-c064ecb257e2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:35.747671 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c215dcfe-88de-4546-ab9d-c064ecb257e2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:35.749123 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c215dcfe-88de-4546-ab9d-c064ecb257e2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:35.750469 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c215dcfe-88de-4546-ab9d-c064ecb257e2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.165147 Sep 05 12:26:35.751575 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 334/663] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:35 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:36.778393 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f24e3a3d-490e-463c-a26b-48ee63819681 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:36.778994 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f24e3a3d-490e-463c-a26b-48ee63819681 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:36.786430 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f24e3a3d-490e-463c-a26b-48ee63819681 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:36.786934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f24e3a3d-490e-463c-a26b-48ee63819681 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:36.787371 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f24e3a3d-490e-463c-a26b-48ee63819681 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:36.788126 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f24e3a3d-490e-463c-a26b-48ee63819681 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:36.788583 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f24e3a3d-490e-463c-a26b-48ee63819681 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:36.789026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f24e3a3d-490e-463c-a26b-48ee63819681 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:37.010570 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f24e3a3d-490e-463c-a26b-48ee63819681 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:37.020208 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f24e3a3d-490e-463c-a26b-48ee63819681 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:37.021803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f24e3a3d-490e-463c-a26b-48ee63819681 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:37.022967 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f24e3a3d-490e-463c-a26b-48ee63819681 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1723 microversion: 2.20 time: 0.249985 Sep 05 12:26:37.023552 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 330/664] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:36 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:37.813259 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-a0bb180a-b0c5-409d-95e3-801f917efb14 req-0ad24275-9929-41c4-a587-279a932deb31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78cd9ae3-2a60-4905-a291-30169e41c86c", "name": "network-vif-deleted", "tag": "6a5ea4f2-8220-4378-84c2-dc1b033a8dd0"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:26:37.825345 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a0bb180a-b0c5-409d-95e3-801f917efb14 req-0ad24275-9929-41c4-a587-279a932deb31 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:37.826440 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a0bb180a-b0c5-409d-95e3-801f917efb14 req-0ad24275-9929-41c4-a587-279a932deb31 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:37.826886 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a0bb180a-b0c5-409d-95e3-801f917efb14 req-0ad24275-9929-41c4-a587-279a932deb31 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:37.840627 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-a0bb180a-b0c5-409d-95e3-801f917efb14 req-0ad24275-9929-41c4-a587-279a932deb31 service nova] Creating event network-vif-deleted:6a5ea4f2-8220-4378-84c2-dc1b033a8dd0 for instance 78cd9ae3-2a60-4905-a291-30169e41c86c on hv-cinder-85518 Sep 05 12:26:37.846579 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-a0bb180a-b0c5-409d-95e3-801f917efb14 req-0ad24275-9929-41c4-a587-279a932deb31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036939 Sep 05 12:26:37.850805 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 335/665] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:26:38.049937 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:38.052012 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:38.059314 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:38.060180 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:38.060848 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:38.061796 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:38.062470 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:38.063104 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:38.098154 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:38.099272 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:38.100137 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:38.100596 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lazy-loading 'fault' on Instance uuid 78cd9ae3-2a60-4905-a291-30169e41c86c {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:26:38.147975 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:38.158572 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:38.160702 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:38.162578 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-071409a7-880a-4477-b3d1-0a70d41283db tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 200 len: 1370 microversion: 2.20 time: 0.117372 Sep 05 12:26:38.163611 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 331/666] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:38 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 1370 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:39.190598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4952ce02-3240-4f3e-b828-48e81fea9afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:39.191326 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4952ce02-3240-4f3e-b828-48e81fea9afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:39.199055 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4952ce02-3240-4f3e-b828-48e81fea9afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:39.199573 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4952ce02-3240-4f3e-b828-48e81fea9afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:39.200016 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4952ce02-3240-4f3e-b828-48e81fea9afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:39.200923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4952ce02-3240-4f3e-b828-48e81fea9afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:39.201380 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4952ce02-3240-4f3e-b828-48e81fea9afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:39.201805 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4952ce02-3240-4f3e-b828-48e81fea9afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:39.216427 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-4952ce02-3240-4f3e-b828-48e81fea9afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] HTTP exception thrown: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4952ce02-3240-4f3e-b828-48e81fea9afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Request method failure captured: Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c HTTP/1.1 Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFekrqRS_NwomMhQqkMVzqnYC2XXZ0Xu1LzWsEsn_xtvRm9kUL9JPxa3yIn1RdmyywzbOT0h0KK1MjXyms-gagh4KPikA3AhPAWq52mOpkm_qo_9hlivRRj93Ft7gaGshkOmAY7XWNDbqsZN0h93vMUX8NhVMq6Js8kBnRNTTiZifl_o Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: ca5b70833b074d199437d3f10e511306 Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:26:39.218131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:26:39.219834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca5b70833b074d199437d3f10e511306", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca5b70833b074d199437d3f10e511306"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca5b70833b074d199437d3f10e511306"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca5b70833b074d199437d3f10e511306"}]}] Sep 05 12:26:39.219834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:26:39.219834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: ca5b70833b074d199437d3f10e511306 Sep 05 12:26:39.219834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:26:39.219834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-AttachVolumeShelveTestJSON-1086800830-project Sep 05 12:26:39.219834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:26:39.219834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:26:39.219834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 83d3b245c185424a9b6e5d69d691f031 Sep 05 12:26:39.219834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1086800830-project Sep 05 12:26:39.219834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:26:39.219834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:26:39.219834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '78cd9ae3-2a60-4905-a291-30169e41c86c'} Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:26:39.220813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:26:39.222409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:26:39.224083 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4952ce02-3240-4f3e-b828-48e81fea9afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Returning 404 to user: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:26:39.224083 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4952ce02-3240-4f3e-b828-48e81fea9afb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 404 len: 111 microversion: 2.20 time: 0.034521 Sep 05 12:26:39.224083 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 336/667] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:39 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 05 12:26:39.229341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-934b5138-7cc5-4fa3-b598-46eb727250c6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '.version_select at 0x7fba4b88c040>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:39.256747 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-934b5138-7cc5-4fa3-b598-46eb727250c6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705731915" status: 204 len: 0 microversion: 2.20 time: 0.031403 Sep 05 12:26:39.257337 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 332/668] 10.222.0.16 () {60 vars in 1259 bytes} [Mon Sep 5 12:26:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705731915 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 05 12:26:40.216800 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-35735dcb-8917-4c45-8451-85b38aececf2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Action: 'create', calling method: .version_select at 0x7fba4b8075e0>, body: {"keypair": {"name": "tempest-keypair-456786505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWxUKwky1h7uTVWgigmoIV83mh4OoR/n1aUN8XI7WsKHHpF2mcD10+xj8AhQXMrxyWO45Q5Ce70XICxB2qtEgIw+X621JlbcsPjX9bpbjsqx70LGjuE+iGS60AnGwU4Og=="}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:26:40.232814 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-35735dcb-8917-4c45-8451-85b38aececf2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Getting quotas for project ca5b70833b074d199437d3f10e511306. Resources: {'key_pairs'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:26:40.236694 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-35735dcb-8917-4c45-8451-85b38aececf2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Getting quotas for user 83d3b245c185424a9b6e5d69d691f031 and project ca5b70833b074d199437d3f10e511306. Resources: {'key_pairs'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:26:40.260724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-35735dcb-8917-4c45-8451-85b38aececf2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047823 Sep 05 12:26:40.261321 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 337/669] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Sep 5 12:26:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 05 12:26:41.868246 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2061902288", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93dc69bc-3411-4656-bd5d-857f16e23b35"}], "security_groups": [{"name": "tempest-securitygroup--1282747669"}], "key_name": "tempest-keypair-456786505", "user_data": "}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:26:41.975930 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.network.neutron [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] validate_networks() for [('93dc69bc-3411-4656-bd5d-857f16e23b35', None, None, None, None, None)] {{(pid=120535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:26:42.350952 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Flavor limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:26:42.351377 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Image limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:26:42.351889 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Flavor pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:26:42.352293 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Image pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:26:42.352705 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:26:42.361969 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:42.362449 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:42.362881 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:42.363629 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:42.364082 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:42.364504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:42.381788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Getting quotas for project ca5b70833b074d199437d3f10e511306. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:26:42.385633 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Getting quotas for user 83d3b245c185424a9b6e5d69d691f031 and project ca5b70833b074d199437d3f10e511306. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:26:42.396409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Going to run 1 instances... {{(pid=120535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:26:42.398677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:26:42.448019 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c975000a-3870-419b-80a4-2378e20eba52 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.584574 Sep 05 12:26:42.448573 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 333/670] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Sep 5 12:26:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 05 12:26:42.460186 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-794ad617-0f19-48de-875d-b140aa571c00 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:42.460786 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-794ad617-0f19-48de-875d-b140aa571c00 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:42.464778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:42.524850 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-794ad617-0f19-48de-875d-b140aa571c00 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:42.533766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-794ad617-0f19-48de-875d-b140aa571c00 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:42.535256 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-794ad617-0f19-48de-875d-b140aa571c00 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:42.536441 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-794ad617-0f19-48de-875d-b140aa571c00 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1281 microversion: 2.20 time: 0.080553 Sep 05 12:26:42.537048 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 338/671] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:42 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:43.562633 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2db4ec80-d50c-4a66-add1-0327a3aad6d1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:43.563829 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2db4ec80-d50c-4a66-add1-0327a3aad6d1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:43.572076 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2db4ec80-d50c-4a66-add1-0327a3aad6d1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:43.572556 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2db4ec80-d50c-4a66-add1-0327a3aad6d1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:43.572998 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2db4ec80-d50c-4a66-add1-0327a3aad6d1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:43.573686 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2db4ec80-d50c-4a66-add1-0327a3aad6d1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:43.574144 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2db4ec80-d50c-4a66-add1-0327a3aad6d1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:43.574553 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2db4ec80-d50c-4a66-add1-0327a3aad6d1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:43.637708 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2db4ec80-d50c-4a66-add1-0327a3aad6d1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:43.646299 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2db4ec80-d50c-4a66-add1-0327a3aad6d1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:43.647789 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2db4ec80-d50c-4a66-add1-0327a3aad6d1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:43.648930 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2db4ec80-d50c-4a66-add1-0327a3aad6d1 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1333 microversion: 2.20 time: 0.090719 Sep 05 12:26:43.649641 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 334/672] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:43 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:44.676069 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d8f585de-0142-4ae3-8345-9b483afc1f0f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:44.676849 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d8f585de-0142-4ae3-8345-9b483afc1f0f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:44.684175 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d8f585de-0142-4ae3-8345-9b483afc1f0f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:44.684691 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d8f585de-0142-4ae3-8345-9b483afc1f0f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:44.685160 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d8f585de-0142-4ae3-8345-9b483afc1f0f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:44.685943 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d8f585de-0142-4ae3-8345-9b483afc1f0f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:44.686606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d8f585de-0142-4ae3-8345-9b483afc1f0f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:44.687267 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d8f585de-0142-4ae3-8345-9b483afc1f0f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:44.836539 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d8f585de-0142-4ae3-8345-9b483afc1f0f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:44.846666 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d8f585de-0142-4ae3-8345-9b483afc1f0f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:44.848157 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d8f585de-0142-4ae3-8345-9b483afc1f0f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:44.849283 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d8f585de-0142-4ae3-8345-9b483afc1f0f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1407 microversion: 2.20 time: 0.178381 Sep 05 12:26:44.849872 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 339/673] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:44 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:45.367196 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-cb29d11b-e30d-4e9c-87a9-7527bd27ac6a req-9f83e7d1-9539-4ef3-a860-801c90511822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0055a73c-7732-48a3-b76b-3b8cc28e7804", "tag": "a65b6d21-8474-43a9-bb2b-2b6a76c853f9"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:26:45.382381 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-cb29d11b-e30d-4e9c-87a9-7527bd27ac6a req-9f83e7d1-9539-4ef3-a860-801c90511822 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:45.382812 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-cb29d11b-e30d-4e9c-87a9-7527bd27ac6a req-9f83e7d1-9539-4ef3-a860-801c90511822 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:45.384070 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-cb29d11b-e30d-4e9c-87a9-7527bd27ac6a req-9f83e7d1-9539-4ef3-a860-801c90511822 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:45.396547 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-cb29d11b-e30d-4e9c-87a9-7527bd27ac6a req-9f83e7d1-9539-4ef3-a860-801c90511822 service nova] Creating event network-changed:a65b6d21-8474-43a9-bb2b-2b6a76c853f9 for instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 on hv-cinder-85518 Sep 05 12:26:45.402670 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-cb29d11b-e30d-4e9c-87a9-7527bd27ac6a req-9f83e7d1-9539-4ef3-a860-801c90511822 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038996 Sep 05 12:26:45.403264 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 335/674] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:26:45.876705 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5f3ac472-213a-40c4-9711-85271652ba19 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:45.878000 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5f3ac472-213a-40c4-9711-85271652ba19 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:45.884578 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f3ac472-213a-40c4-9711-85271652ba19 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:45.885061 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f3ac472-213a-40c4-9711-85271652ba19 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:45.885506 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f3ac472-213a-40c4-9711-85271652ba19 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:45.886206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f3ac472-213a-40c4-9711-85271652ba19 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:45.886664 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f3ac472-213a-40c4-9711-85271652ba19 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:45.887094 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5f3ac472-213a-40c4-9711-85271652ba19 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:46.029659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5f3ac472-213a-40c4-9711-85271652ba19 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:46.037808 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5f3ac472-213a-40c4-9711-85271652ba19 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:46.039251 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5f3ac472-213a-40c4-9711-85271652ba19 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:46.040391 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5f3ac472-213a-40c4-9711-85271652ba19 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1407 microversion: 2.20 time: 0.169113 Sep 05 12:26:46.040964 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 340/675] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:45 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:47.068789 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2cc3ec29-2dca-4264-961a-e4be2c3b459a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:47.069612 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2cc3ec29-2dca-4264-961a-e4be2c3b459a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:47.077608 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2cc3ec29-2dca-4264-961a-e4be2c3b459a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:47.078132 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2cc3ec29-2dca-4264-961a-e4be2c3b459a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:47.078713 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2cc3ec29-2dca-4264-961a-e4be2c3b459a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:47.080241 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2cc3ec29-2dca-4264-961a-e4be2c3b459a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:47.080820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2cc3ec29-2dca-4264-961a-e4be2c3b459a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:47.081361 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2cc3ec29-2dca-4264-961a-e4be2c3b459a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:47.242203 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2cc3ec29-2dca-4264-961a-e4be2c3b459a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:47.251469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2cc3ec29-2dca-4264-961a-e4be2c3b459a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:47.252975 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2cc3ec29-2dca-4264-961a-e4be2c3b459a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:47.254105 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2cc3ec29-2dca-4264-961a-e4be2c3b459a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1407 microversion: 2.20 time: 0.192351 Sep 05 12:26:47.254674 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 336/676] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:47 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:48.280857 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-18ed441f-6108-44ef-a37a-3358f80848be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:48.281469 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-18ed441f-6108-44ef-a37a-3358f80848be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:48.288631 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-18ed441f-6108-44ef-a37a-3358f80848be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:48.289157 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-18ed441f-6108-44ef-a37a-3358f80848be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:48.289594 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-18ed441f-6108-44ef-a37a-3358f80848be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:48.290296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-18ed441f-6108-44ef-a37a-3358f80848be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:48.290741 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-18ed441f-6108-44ef-a37a-3358f80848be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:48.291162 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-18ed441f-6108-44ef-a37a-3358f80848be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:48.443203 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-18ed441f-6108-44ef-a37a-3358f80848be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:48.453497 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-18ed441f-6108-44ef-a37a-3358f80848be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:48.455576 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-18ed441f-6108-44ef-a37a-3358f80848be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:48.456741 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-18ed441f-6108-44ef-a37a-3358f80848be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1407 microversion: 2.20 time: 0.180256 Sep 05 12:26:48.457341 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 341/677] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:48 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:26:49.482073 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-cbd4acc8-523d-4713-8279-bccdbc1c3eb7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:49.482706 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-cbd4acc8-523d-4713-8279-bccdbc1c3eb7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:49.485397 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:49.491466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cbd4acc8-523d-4713-8279-bccdbc1c3eb7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:49.491987 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cbd4acc8-523d-4713-8279-bccdbc1c3eb7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:49.492427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cbd4acc8-523d-4713-8279-bccdbc1c3eb7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:49.493141 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cbd4acc8-523d-4713-8279-bccdbc1c3eb7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:49.493598 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cbd4acc8-523d-4713-8279-bccdbc1c3eb7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:49.494120 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cbd4acc8-523d-4713-8279-bccdbc1c3eb7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:49.652060 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-cbd4acc8-523d-4713-8279-bccdbc1c3eb7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:49.660880 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-cbd4acc8-523d-4713-8279-bccdbc1c3eb7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:49.662311 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-cbd4acc8-523d-4713-8279-bccdbc1c3eb7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:49.663422 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-cbd4acc8-523d-4713-8279-bccdbc1c3eb7 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1407 microversion: 2.20 time: 0.185313 Sep 05 12:26:49.664012 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 337/678] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:49 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:50.689447 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a95ba181-70a9-4df1-a9cb-5c1729fd50e0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:50.689986 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a95ba181-70a9-4df1-a9cb-5c1729fd50e0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:50.696407 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a95ba181-70a9-4df1-a9cb-5c1729fd50e0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:50.696889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a95ba181-70a9-4df1-a9cb-5c1729fd50e0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:50.697326 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a95ba181-70a9-4df1-a9cb-5c1729fd50e0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:50.698048 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a95ba181-70a9-4df1-a9cb-5c1729fd50e0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:50.698503 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a95ba181-70a9-4df1-a9cb-5c1729fd50e0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:50.698932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a95ba181-70a9-4df1-a9cb-5c1729fd50e0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:50.829724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a95ba181-70a9-4df1-a9cb-5c1729fd50e0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:50.838032 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a95ba181-70a9-4df1-a9cb-5c1729fd50e0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:50.839470 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a95ba181-70a9-4df1-a9cb-5c1729fd50e0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:50.840605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a95ba181-70a9-4df1-a9cb-5c1729fd50e0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1407 microversion: 2.20 time: 0.155199 Sep 05 12:26:50.841168 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 342/679] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:50 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:51.866164 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-936c510f-2528-4c22-82ef-486ad4242e90 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:51.866774 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-936c510f-2528-4c22-82ef-486ad4242e90 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:51.873375 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-936c510f-2528-4c22-82ef-486ad4242e90 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:51.873866 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-936c510f-2528-4c22-82ef-486ad4242e90 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:51.874298 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-936c510f-2528-4c22-82ef-486ad4242e90 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:51.875005 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-936c510f-2528-4c22-82ef-486ad4242e90 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:51.875461 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-936c510f-2528-4c22-82ef-486ad4242e90 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:51.875912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-936c510f-2528-4c22-82ef-486ad4242e90 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:52.004134 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-936c510f-2528-4c22-82ef-486ad4242e90 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:52.012176 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-936c510f-2528-4c22-82ef-486ad4242e90 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:52.014740 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-936c510f-2528-4c22-82ef-486ad4242e90 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:52.015872 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-936c510f-2528-4c22-82ef-486ad4242e90 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1407 microversion: 2.20 time: 0.153615 Sep 05 12:26:52.016431 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 338/680] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:51 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:53.042303 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e649a45a-0768-4f7e-ab68-bcdf5e819885 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:53.042908 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e649a45a-0768-4f7e-ab68-bcdf5e819885 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:53.045204 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=6 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:53.050460 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e649a45a-0768-4f7e-ab68-bcdf5e819885 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:53.051614 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e649a45a-0768-4f7e-ab68-bcdf5e819885 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:53.052048 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e649a45a-0768-4f7e-ab68-bcdf5e819885 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:53.052742 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e649a45a-0768-4f7e-ab68-bcdf5e819885 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:53.053183 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e649a45a-0768-4f7e-ab68-bcdf5e819885 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:53.053604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e649a45a-0768-4f7e-ab68-bcdf5e819885 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:53.181205 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e649a45a-0768-4f7e-ab68-bcdf5e819885 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:53.190656 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e649a45a-0768-4f7e-ab68-bcdf5e819885 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:53.192137 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e649a45a-0768-4f7e-ab68-bcdf5e819885 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:53.193289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e649a45a-0768-4f7e-ab68-bcdf5e819885 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1407 microversion: 2.20 time: 0.154832 Sep 05 12:26:53.193847 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 343/681] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:53 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:53.298288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-9a46be50-65af-4273-bac6-ad696bf24f45 req-ebb12eb0-062c-456e-baaf-671838d99d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0055a73c-7732-48a3-b76b-3b8cc28e7804", "name": "network-vif-plugged", "status": "completed", "tag": "a65b6d21-8474-43a9-bb2b-2b6a76c853f9"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:26:53.303378 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:53.304111 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=6 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:53.312371 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-9a46be50-65af-4273-bac6-ad696bf24f45 req-ebb12eb0-062c-456e-baaf-671838d99d78 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:53.312860 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-9a46be50-65af-4273-bac6-ad696bf24f45 req-ebb12eb0-062c-456e-baaf-671838d99d78 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:53.313295 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-9a46be50-65af-4273-bac6-ad696bf24f45 req-ebb12eb0-062c-456e-baaf-671838d99d78 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:53.324182 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-9a46be50-65af-4273-bac6-ad696bf24f45 req-ebb12eb0-062c-456e-baaf-671838d99d78 service nova] Creating event network-vif-plugged:a65b6d21-8474-43a9-bb2b-2b6a76c853f9 for instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 on hv-cinder-85518 Sep 05 12:26:53.329468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-9a46be50-65af-4273-bac6-ad696bf24f45 req-ebb12eb0-062c-456e-baaf-671838d99d78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034792 Sep 05 12:26:53.330216 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 339/682] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:26:54.221027 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-facd04f1-d03e-448a-b479-88f4bad5f8ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:54.221599 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-facd04f1-d03e-448a-b479-88f4bad5f8ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:54.228321 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-facd04f1-d03e-448a-b479-88f4bad5f8ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:54.228801 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-facd04f1-d03e-448a-b479-88f4bad5f8ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:54.229237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-facd04f1-d03e-448a-b479-88f4bad5f8ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:54.229929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-facd04f1-d03e-448a-b479-88f4bad5f8ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:54.230380 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-facd04f1-d03e-448a-b479-88f4bad5f8ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:54.230801 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-facd04f1-d03e-448a-b479-88f4bad5f8ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:54.360468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-facd04f1-d03e-448a-b479-88f4bad5f8ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:54.369714 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-facd04f1-d03e-448a-b479-88f4bad5f8ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:54.371171 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-facd04f1-d03e-448a-b479-88f4bad5f8ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:54.372327 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-facd04f1-d03e-448a-b479-88f4bad5f8ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1407 microversion: 2.20 time: 0.156676 Sep 05 12:26:54.374469 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 344/683] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:54 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:55.399970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a47b295a-7900-46ac-a68c-56ad7606947c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:55.400695 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a47b295a-7900-46ac-a68c-56ad7606947c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:55.413382 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a47b295a-7900-46ac-a68c-56ad7606947c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:55.413869 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a47b295a-7900-46ac-a68c-56ad7606947c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:55.414308 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a47b295a-7900-46ac-a68c-56ad7606947c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:55.415006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a47b295a-7900-46ac-a68c-56ad7606947c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:55.415465 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a47b295a-7900-46ac-a68c-56ad7606947c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:55.415917 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a47b295a-7900-46ac-a68c-56ad7606947c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:55.551236 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a47b295a-7900-46ac-a68c-56ad7606947c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:55.559958 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a47b295a-7900-46ac-a68c-56ad7606947c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:55.561388 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a47b295a-7900-46ac-a68c-56ad7606947c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:55.562530 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a47b295a-7900-46ac-a68c-56ad7606947c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1407 microversion: 2.20 time: 0.168032 Sep 05 12:26:55.563087 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 340/684] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:55 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:56.588181 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-849a9ab7-f928-42b7-a14d-e4f82c890a1f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:56.588802 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-849a9ab7-f928-42b7-a14d-e4f82c890a1f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:56.595225 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-849a9ab7-f928-42b7-a14d-e4f82c890a1f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:56.595753 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-849a9ab7-f928-42b7-a14d-e4f82c890a1f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:56.596187 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-849a9ab7-f928-42b7-a14d-e4f82c890a1f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:56.596896 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-849a9ab7-f928-42b7-a14d-e4f82c890a1f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:56.597350 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-849a9ab7-f928-42b7-a14d-e4f82c890a1f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:56.597768 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-849a9ab7-f928-42b7-a14d-e4f82c890a1f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:56.741847 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-849a9ab7-f928-42b7-a14d-e4f82c890a1f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:56.750899 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-849a9ab7-f928-42b7-a14d-e4f82c890a1f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:56.752462 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-849a9ab7-f928-42b7-a14d-e4f82c890a1f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:26:56.753807 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-849a9ab7-f928-42b7-a14d-e4f82c890a1f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1599 microversion: 2.20 time: 0.169781 Sep 05 12:26:56.754371 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 345/685] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:26:56 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:26:56.780090 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e3ef5083-c50b-4c1f-b722-a83406fe6350 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:26:56.780635 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e3ef5083-c50b-4c1f-b722-a83406fe6350 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:26:56.788600 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e3ef5083-c50b-4c1f-b722-a83406fe6350 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:56.789088 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e3ef5083-c50b-4c1f-b722-a83406fe6350 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:56.789523 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e3ef5083-c50b-4c1f-b722-a83406fe6350 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:56.790314 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e3ef5083-c50b-4c1f-b722-a83406fe6350 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:56.790676 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e3ef5083-c50b-4c1f-b722-a83406fe6350 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:56.791102 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e3ef5083-c50b-4c1f-b722-a83406fe6350 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:56.795276 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:56.876642 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e3ef5083-c50b-4c1f-b722-a83406fe6350 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100637 Sep 05 12:26:56.877403 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 341/686] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Sep 5 12:26:56 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:26:57.931424 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-52305022-64eb-416c-b261-20c4f750a125 req-b16c3713-acc9-42e5-a6a3-c3e976d1ef16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0055a73c-7732-48a3-b76b-3b8cc28e7804", "tag": "a65b6d21-8474-43a9-bb2b-2b6a76c853f9"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:26:57.941272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-52305022-64eb-416c-b261-20c4f750a125 req-b16c3713-acc9-42e5-a6a3-c3e976d1ef16 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:26:57.941759 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-52305022-64eb-416c-b261-20c4f750a125 req-b16c3713-acc9-42e5-a6a3-c3e976d1ef16 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:26:57.942794 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-52305022-64eb-416c-b261-20c4f750a125 req-b16c3713-acc9-42e5-a6a3-c3e976d1ef16 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:26:57.954780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-52305022-64eb-416c-b261-20c4f750a125 req-b16c3713-acc9-42e5-a6a3-c3e976d1ef16 service nova] Creating event network-changed:a65b6d21-8474-43a9-bb2b-2b6a76c853f9 for instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 on hv-cinder-85518 Sep 05 12:26:57.960452 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-52305022-64eb-416c-b261-20c4f750a125 req-b16c3713-acc9-42e5-a6a3-c3e976d1ef16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138116 Sep 05 12:26:57.961056 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 346/687] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:11.890408 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=9 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:11.891138 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:11.895291 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5c6ded8c-be6e-4b84-8223-45cb4be308d7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:27:11.895847 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5c6ded8c-be6e-4b84-8223-45cb4be308d7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:11.903440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c6ded8c-be6e-4b84-8223-45cb4be308d7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:11.903807 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c6ded8c-be6e-4b84-8223-45cb4be308d7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:11.904287 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c6ded8c-be6e-4b84-8223-45cb4be308d7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:11.904958 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c6ded8c-be6e-4b84-8223-45cb4be308d7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:11.905403 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c6ded8c-be6e-4b84-8223-45cb4be308d7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:11.905820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5c6ded8c-be6e-4b84-8223-45cb4be308d7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:11.928275 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-5c6ded8c-be6e-4b84-8223-45cb4be308d7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lazy-loading 'flavor' on Instance uuid 4181d872-fbd4-4b16-b8c2-d086dd1253b2 {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:27:11.997144 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5c6ded8c-be6e-4b84-8223-45cb4be308d7 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "POST /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2/action" status: 202 len: 0 microversion: 2.1 time: 0.107882 Sep 05 12:27:11.997728 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 342/688] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Sep 5 12:27:11 2022] POST /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 12:27:12.004218 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=19 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:12.004951 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=92 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:12.009993 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-816f8959-340a-4f79-a00f-e5a1f25f99d3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:12.010312 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-816f8959-340a-4f79-a00f-e5a1f25f99d3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:12.017965 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-816f8959-340a-4f79-a00f-e5a1f25f99d3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:12.018510 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-816f8959-340a-4f79-a00f-e5a1f25f99d3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:12.018880 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-816f8959-340a-4f79-a00f-e5a1f25f99d3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:12.019666 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-816f8959-340a-4f79-a00f-e5a1f25f99d3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:12.020063 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-816f8959-340a-4f79-a00f-e5a1f25f99d3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:12.020742 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-816f8959-340a-4f79-a00f-e5a1f25f99d3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:12.164856 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-816f8959-340a-4f79-a00f-e5a1f25f99d3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:12.173346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-816f8959-340a-4f79-a00f-e5a1f25f99d3 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.170855 Sep 05 12:27:12.173791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 347/689] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:12 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:13.197541 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e11ffdfa-f3ba-4968-863d-bff4ac49e925 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:13.198246 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e11ffdfa-f3ba-4968-863d-bff4ac49e925 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:13.204567 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e11ffdfa-f3ba-4968-863d-bff4ac49e925 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:13.205052 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e11ffdfa-f3ba-4968-863d-bff4ac49e925 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:13.205483 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e11ffdfa-f3ba-4968-863d-bff4ac49e925 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:13.206174 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e11ffdfa-f3ba-4968-863d-bff4ac49e925 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:13.206623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e11ffdfa-f3ba-4968-863d-bff4ac49e925 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:13.207048 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e11ffdfa-f3ba-4968-863d-bff4ac49e925 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:13.346602 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e11ffdfa-f3ba-4968-863d-bff4ac49e925 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:13.355274 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e11ffdfa-f3ba-4968-863d-bff4ac49e925 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.162500 Sep 05 12:27:13.355876 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 343/690] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:13 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:14.381837 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8a4b6db4-243d-4661-af1e-5e55f9ef1b9f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:14.382462 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-8a4b6db4-243d-4661-af1e-5e55f9ef1b9f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:14.388926 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8a4b6db4-243d-4661-af1e-5e55f9ef1b9f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:14.389418 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8a4b6db4-243d-4661-af1e-5e55f9ef1b9f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:14.389861 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8a4b6db4-243d-4661-af1e-5e55f9ef1b9f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:14.390629 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8a4b6db4-243d-4661-af1e-5e55f9ef1b9f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:14.391227 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8a4b6db4-243d-4661-af1e-5e55f9ef1b9f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:14.391801 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8a4b6db4-243d-4661-af1e-5e55f9ef1b9f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:14.524677 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8a4b6db4-243d-4661-af1e-5e55f9ef1b9f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:14.532647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8a4b6db4-243d-4661-af1e-5e55f9ef1b9f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.157086 Sep 05 12:27:14.533218 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 348/691] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:14 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:15.556634 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-210d9bd4-b25b-480e-9e97-5e5dc3ec1c8c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:15.557240 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-210d9bd4-b25b-480e-9e97-5e5dc3ec1c8c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:15.563125 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-210d9bd4-b25b-480e-9e97-5e5dc3ec1c8c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:15.563625 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-210d9bd4-b25b-480e-9e97-5e5dc3ec1c8c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:15.564059 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-210d9bd4-b25b-480e-9e97-5e5dc3ec1c8c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:15.564736 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-210d9bd4-b25b-480e-9e97-5e5dc3ec1c8c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:15.565184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-210d9bd4-b25b-480e-9e97-5e5dc3ec1c8c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:15.565601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-210d9bd4-b25b-480e-9e97-5e5dc3ec1c8c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:15.696278 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-210d9bd4-b25b-480e-9e97-5e5dc3ec1c8c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:15.704070 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-210d9bd4-b25b-480e-9e97-5e5dc3ec1c8c tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.151448 Sep 05 12:27:15.704635 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 344/692] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:15 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:16.728148 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4a97577d-ee9d-4503-837d-1c4821b1523b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:16.728682 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4a97577d-ee9d-4503-837d-1c4821b1523b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:16.735037 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4a97577d-ee9d-4503-837d-1c4821b1523b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:16.735512 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4a97577d-ee9d-4503-837d-1c4821b1523b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:16.735969 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4a97577d-ee9d-4503-837d-1c4821b1523b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:16.736649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4a97577d-ee9d-4503-837d-1c4821b1523b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:16.737096 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4a97577d-ee9d-4503-837d-1c4821b1523b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:16.737516 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4a97577d-ee9d-4503-837d-1c4821b1523b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:16.871036 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4a97577d-ee9d-4503-837d-1c4821b1523b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:16.878853 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4a97577d-ee9d-4503-837d-1c4821b1523b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.155274 Sep 05 12:27:16.879431 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 349/693] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:16 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:17.904202 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-980d624a-55a9-4816-8d4d-0abf1fb4800a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:17.904742 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-980d624a-55a9-4816-8d4d-0abf1fb4800a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:17.911075 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-980d624a-55a9-4816-8d4d-0abf1fb4800a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:17.911572 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-980d624a-55a9-4816-8d4d-0abf1fb4800a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:17.912003 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-980d624a-55a9-4816-8d4d-0abf1fb4800a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:17.913354 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-980d624a-55a9-4816-8d4d-0abf1fb4800a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:17.913802 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-980d624a-55a9-4816-8d4d-0abf1fb4800a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:17.914220 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-980d624a-55a9-4816-8d4d-0abf1fb4800a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:18.047986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-980d624a-55a9-4816-8d4d-0abf1fb4800a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:18.055671 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-980d624a-55a9-4816-8d4d-0abf1fb4800a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.155612 Sep 05 12:27:18.056229 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 345/694] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:17 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:19.179837 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2c64b7cf-b120-475c-bcf9-19b5082fa22a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:19.180462 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2c64b7cf-b120-475c-bcf9-19b5082fa22a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:19.186495 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c64b7cf-b120-475c-bcf9-19b5082fa22a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:19.186979 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c64b7cf-b120-475c-bcf9-19b5082fa22a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:19.187418 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c64b7cf-b120-475c-bcf9-19b5082fa22a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:19.188161 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c64b7cf-b120-475c-bcf9-19b5082fa22a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:19.188703 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c64b7cf-b120-475c-bcf9-19b5082fa22a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:19.189136 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c64b7cf-b120-475c-bcf9-19b5082fa22a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:19.322492 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2c64b7cf-b120-475c-bcf9-19b5082fa22a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:19.330460 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2c64b7cf-b120-475c-bcf9-19b5082fa22a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.255855 Sep 05 12:27:19.331029 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 350/695] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:19 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:20.353476 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-247537c9-dcd4-43ac-b005-77a52c9e4953 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:20.354063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-247537c9-dcd4-43ac-b005-77a52c9e4953 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:20.360369 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-247537c9-dcd4-43ac-b005-77a52c9e4953 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:20.360842 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-247537c9-dcd4-43ac-b005-77a52c9e4953 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:20.361266 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-247537c9-dcd4-43ac-b005-77a52c9e4953 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:20.361939 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-247537c9-dcd4-43ac-b005-77a52c9e4953 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:20.362386 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-247537c9-dcd4-43ac-b005-77a52c9e4953 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:20.362808 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-247537c9-dcd4-43ac-b005-77a52c9e4953 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:20.491727 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-247537c9-dcd4-43ac-b005-77a52c9e4953 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:20.499464 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-247537c9-dcd4-43ac-b005-77a52c9e4953 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.149840 Sep 05 12:27:20.500057 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 346/696] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:20 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:21.524389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0705e365-a58e-4013-be5c-17faff26805e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:21.525029 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0705e365-a58e-4013-be5c-17faff26805e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:21.532061 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0705e365-a58e-4013-be5c-17faff26805e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:21.532541 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0705e365-a58e-4013-be5c-17faff26805e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:21.532975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0705e365-a58e-4013-be5c-17faff26805e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:21.533669 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0705e365-a58e-4013-be5c-17faff26805e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:21.534130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0705e365-a58e-4013-be5c-17faff26805e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:21.534556 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0705e365-a58e-4013-be5c-17faff26805e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:21.679121 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0705e365-a58e-4013-be5c-17faff26805e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:21.690803 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0705e365-a58e-4013-be5c-17faff26805e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.170676 Sep 05 12:27:21.691462 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 351/697] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:21 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:22.716260 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e639d248-8dd5-4f57-bbde-6a99f5b9cc10 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:22.716889 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e639d248-8dd5-4f57-bbde-6a99f5b9cc10 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:22.724094 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e639d248-8dd5-4f57-bbde-6a99f5b9cc10 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:22.724590 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e639d248-8dd5-4f57-bbde-6a99f5b9cc10 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:22.725032 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e639d248-8dd5-4f57-bbde-6a99f5b9cc10 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:22.726278 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e639d248-8dd5-4f57-bbde-6a99f5b9cc10 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:22.726743 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e639d248-8dd5-4f57-bbde-6a99f5b9cc10 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:22.727170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e639d248-8dd5-4f57-bbde-6a99f5b9cc10 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:22.931809 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e639d248-8dd5-4f57-bbde-6a99f5b9cc10 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:22.939898 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e639d248-8dd5-4f57-bbde-6a99f5b9cc10 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.227412 Sep 05 12:27:22.940524 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 347/698] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:22 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:23.964427 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3c3e0777-a592-4836-afc3-5dca00d3706f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:23.965045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-3c3e0777-a592-4836-afc3-5dca00d3706f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:23.971756 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c3e0777-a592-4836-afc3-5dca00d3706f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:23.972243 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c3e0777-a592-4836-afc3-5dca00d3706f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:23.972681 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c3e0777-a592-4836-afc3-5dca00d3706f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:23.973382 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c3e0777-a592-4836-afc3-5dca00d3706f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:23.973839 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c3e0777-a592-4836-afc3-5dca00d3706f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:23.974268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c3e0777-a592-4836-afc3-5dca00d3706f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:24.113007 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-3c3e0777-a592-4836-afc3-5dca00d3706f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:24.121789 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-3c3e0777-a592-4836-afc3-5dca00d3706f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.161650 Sep 05 12:27:24.122383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 352/699] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:23 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:24.414548 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-3cf94940-b671-478d-87bd-d83220c31cd0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:24.415454 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3cf94940-b671-478d-87bd-d83220c31cd0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:24.427286 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3cf94940-b671-478d-87bd-d83220c31cd0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:24.428293 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3cf94940-b671-478d-87bd-d83220c31cd0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:24.429092 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3cf94940-b671-478d-87bd-d83220c31cd0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:24.430346 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3cf94940-b671-478d-87bd-d83220c31cd0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:24.431196 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3cf94940-b671-478d-87bd-d83220c31cd0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:24.432037 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3cf94940-b671-478d-87bd-d83220c31cd0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:24.520260 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-3cf94940-b671-478d-87bd-d83220c31cd0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lazy-loading 'services' on Instance uuid f64534ca-02f1-4369-94ac-1b50a063b870 {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:27:24.601653 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-3cf94940-b671-478d-87bd-d83220c31cd0 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-volume_attachments/300fc6ef-2603-4e6c-9b2c-9a7874cc32c2" status: 202 len: 0 microversion: 2.1 time: 0.194990 Sep 05 12:27:24.602237 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 348/700] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Sep 5 12:27:24 2022] DELETE /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-volume_attachments/300fc6ef-2603-4e6c-9b2c-9a7874cc32c2 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:27:24.610728 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f991f779-a0a7-44b2-b562-1e044d7c8ae2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:24.613019 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f991f779-a0a7-44b2-b562-1e044d7c8ae2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:24.621333 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f991f779-a0a7-44b2-b562-1e044d7c8ae2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:24.621828 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f991f779-a0a7-44b2-b562-1e044d7c8ae2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:24.622275 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f991f779-a0a7-44b2-b562-1e044d7c8ae2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:24.622983 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f991f779-a0a7-44b2-b562-1e044d7c8ae2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:24.623438 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f991f779-a0a7-44b2-b562-1e044d7c8ae2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:24.623890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f991f779-a0a7-44b2-b562-1e044d7c8ae2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:24.657839 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f991f779-a0a7-44b2-b562-1e044d7c8ae2 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050968 Sep 05 12:27:24.658416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 353/701] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:27:24 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:25.146171 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d6650d4d-235e-44bc-8812-d20213a5bbfd tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:25.146869 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d6650d4d-235e-44bc-8812-d20213a5bbfd tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:25.154517 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d6650d4d-235e-44bc-8812-d20213a5bbfd tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:25.155021 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d6650d4d-235e-44bc-8812-d20213a5bbfd tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:25.155453 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d6650d4d-235e-44bc-8812-d20213a5bbfd tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:25.156177 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d6650d4d-235e-44bc-8812-d20213a5bbfd tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:25.156628 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d6650d4d-235e-44bc-8812-d20213a5bbfd tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:25.157047 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d6650d4d-235e-44bc-8812-d20213a5bbfd tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:25.301573 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d6650d4d-235e-44bc-8812-d20213a5bbfd tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:25.309961 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d6650d4d-235e-44bc-8812-d20213a5bbfd tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.168029 Sep 05 12:27:25.310535 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 349/702] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:25 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:25.671824 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-da8aca58-6f4b-4954-aa6a-d77a4eff54ce tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:25.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-da8aca58-6f4b-4954-aa6a-d77a4eff54ce tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:25.680108 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-da8aca58-6f4b-4954-aa6a-d77a4eff54ce tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:25.680608 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-da8aca58-6f4b-4954-aa6a-d77a4eff54ce tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:25.681095 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-da8aca58-6f4b-4954-aa6a-d77a4eff54ce tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:25.681904 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-da8aca58-6f4b-4954-aa6a-d77a4eff54ce tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:25.682461 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-da8aca58-6f4b-4954-aa6a-d77a4eff54ce tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:25.682872 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-da8aca58-6f4b-4954-aa6a-d77a4eff54ce tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:25.718812 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-da8aca58-6f4b-4954-aa6a-d77a4eff54ce tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047590 Sep 05 12:27:25.718812 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 354/703] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:27:25 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:26.333211 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f389ba8f-0811-4656-92c6-f0d45f3efa0f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:26.333798 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f389ba8f-0811-4656-92c6-f0d45f3efa0f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:26.340333 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f389ba8f-0811-4656-92c6-f0d45f3efa0f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:26.340824 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f389ba8f-0811-4656-92c6-f0d45f3efa0f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:26.341291 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f389ba8f-0811-4656-92c6-f0d45f3efa0f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:26.342013 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f389ba8f-0811-4656-92c6-f0d45f3efa0f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:26.342466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f389ba8f-0811-4656-92c6-f0d45f3efa0f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:26.342890 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f389ba8f-0811-4656-92c6-f0d45f3efa0f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:26.474177 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f389ba8f-0811-4656-92c6-f0d45f3efa0f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:26.483226 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f389ba8f-0811-4656-92c6-f0d45f3efa0f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1570 microversion: 2.1 time: 0.153867 Sep 05 12:27:26.484208 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 350/704] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:26 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:26.507749 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-02db4eb7-5353-4c91-8851-39dd84b4a795 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:27:26.508349 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-02db4eb7-5353-4c91-8851-39dd84b4a795 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:26.514632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-02db4eb7-5353-4c91-8851-39dd84b4a795 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:26.515109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-02db4eb7-5353-4c91-8851-39dd84b4a795 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:26.515567 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-02db4eb7-5353-4c91-8851-39dd84b4a795 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:26.516260 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-02db4eb7-5353-4c91-8851-39dd84b4a795 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:26.516712 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-02db4eb7-5353-4c91-8851-39dd84b4a795 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:26.517136 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-02db4eb7-5353-4c91-8851-39dd84b4a795 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:26.629622 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-02db4eb7-5353-4c91-8851-39dd84b4a795 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120534) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 05 12:27:26.697426 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-02db4eb7-5353-4c91-8851-39dd84b4a795 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "POST /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2/action" status: 202 len: 0 microversion: 2.1 time: 0.194765 Sep 05 12:27:26.701096 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 355/705] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Sep 5 12:27:26 2022] POST /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:27:26.709317 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8c6c7b9f-68a9-4a95-9a0e-bd9f65c4fceb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:26.709931 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8c6c7b9f-68a9-4a95-9a0e-bd9f65c4fceb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:26.715828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8c6c7b9f-68a9-4a95-9a0e-bd9f65c4fceb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:26.716311 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8c6c7b9f-68a9-4a95-9a0e-bd9f65c4fceb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:26.716745 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8c6c7b9f-68a9-4a95-9a0e-bd9f65c4fceb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:26.717440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8c6c7b9f-68a9-4a95-9a0e-bd9f65c4fceb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:26.717891 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8c6c7b9f-68a9-4a95-9a0e-bd9f65c4fceb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:26.718311 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8c6c7b9f-68a9-4a95-9a0e-bd9f65c4fceb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:26.729533 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3c7cc9b4-c2bb-4699-8e40-e5fc512f137a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:26.731869 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-3c7cc9b4-c2bb-4699-8e40-e5fc512f137a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:26.739632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c7cc9b4-c2bb-4699-8e40-e5fc512f137a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:26.739905 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c7cc9b4-c2bb-4699-8e40-e5fc512f137a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:26.740344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c7cc9b4-c2bb-4699-8e40-e5fc512f137a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:26.741229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c7cc9b4-c2bb-4699-8e40-e5fc512f137a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:26.741716 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c7cc9b4-c2bb-4699-8e40-e5fc512f137a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:26.742927 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3c7cc9b4-c2bb-4699-8e40-e5fc512f137a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:26.776326 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-3c7cc9b4-c2bb-4699-8e40-e5fc512f137a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052392 Sep 05 12:27:26.777144 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 356/706] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:27:26 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 05 12:27:26.861897 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9b0bda1a-b525-4396-83f3-8c925296a14b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:26.862831 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9b0bda1a-b525-4396-83f3-8c925296a14b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:26.869921 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9b0bda1a-b525-4396-83f3-8c925296a14b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:26.870687 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9b0bda1a-b525-4396-83f3-8c925296a14b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:26.871359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9b0bda1a-b525-4396-83f3-8c925296a14b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:26.872314 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9b0bda1a-b525-4396-83f3-8c925296a14b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:26.873101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9b0bda1a-b525-4396-83f3-8c925296a14b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:26.873730 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9b0bda1a-b525-4396-83f3-8c925296a14b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:26.878045 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8c6c7b9f-68a9-4a95-9a0e-bd9f65c4fceb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:26.886769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8c6c7b9f-68a9-4a95-9a0e-bd9f65c4fceb tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1518 microversion: 2.1 time: 0.181257 Sep 05 12:27:26.887345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 351/707] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:26 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:26.905312 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9b0bda1a-b525-4396-83f3-8c925296a14b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Going to try to terminate instance {{(pid=120534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:27:26.989638 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9b0bda1a-b525-4396-83f3-8c925296a14b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 204 len: 0 microversion: 2.1 time: 0.131157 Sep 05 12:27:26.990352 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 357/708] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:27:26 2022] DELETE /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:27:27.006047 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e7dfd683-363e-40ff-9724-4fb3b6887c33 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:27.006751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e7dfd683-363e-40ff-9724-4fb3b6887c33 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:27.013189 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e7dfd683-363e-40ff-9724-4fb3b6887c33 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:27.013677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e7dfd683-363e-40ff-9724-4fb3b6887c33 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:27.014112 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e7dfd683-363e-40ff-9724-4fb3b6887c33 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:27.014813 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e7dfd683-363e-40ff-9724-4fb3b6887c33 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:27.015266 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e7dfd683-363e-40ff-9724-4fb3b6887c33 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:27.015728 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e7dfd683-363e-40ff-9724-4fb3b6887c33 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:27.145341 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e7dfd683-363e-40ff-9724-4fb3b6887c33 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:27.154026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e7dfd683-363e-40ff-9724-4fb3b6887c33 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1688 microversion: 2.1 time: 0.152920 Sep 05 12:27:27.154477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 352/709] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:26 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:27.911378 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d60b8485-c652-467f-a8ed-64c88fa64f11 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:27.912118 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d60b8485-c652-467f-a8ed-64c88fa64f11 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:27.918614 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d60b8485-c652-467f-a8ed-64c88fa64f11 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:27.919101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d60b8485-c652-467f-a8ed-64c88fa64f11 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:27.919560 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d60b8485-c652-467f-a8ed-64c88fa64f11 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:27.920268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d60b8485-c652-467f-a8ed-64c88fa64f11 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:27.920727 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d60b8485-c652-467f-a8ed-64c88fa64f11 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:27.921158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d60b8485-c652-467f-a8ed-64c88fa64f11 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:28.052900 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d60b8485-c652-467f-a8ed-64c88fa64f11 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:28.061243 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d60b8485-c652-467f-a8ed-64c88fa64f11 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1518 microversion: 2.1 time: 0.154106 Sep 05 12:27:28.061808 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 358/710] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:27 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:28.177207 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2976cace-5bf0-4f48-860e-867d4a475beb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:28.177737 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2976cace-5bf0-4f48-860e-867d4a475beb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:28.184820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2976cace-5bf0-4f48-860e-867d4a475beb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:28.185307 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2976cace-5bf0-4f48-860e-867d4a475beb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:28.185741 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2976cace-5bf0-4f48-860e-867d4a475beb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:28.186431 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2976cace-5bf0-4f48-860e-867d4a475beb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:28.186890 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2976cace-5bf0-4f48-860e-867d4a475beb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:28.187319 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2976cace-5bf0-4f48-860e-867d4a475beb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:28.318661 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2976cace-5bf0-4f48-860e-867d4a475beb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:28.326335 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2976cace-5bf0-4f48-860e-867d4a475beb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1688 microversion: 2.1 time: 0.153021 Sep 05 12:27:28.326892 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 353/711] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:28 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:29.084099 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f02392d1-4d1a-40c0-996c-7ef15d3c6696 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:29.084704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f02392d1-4d1a-40c0-996c-7ef15d3c6696 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:29.091958 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f02392d1-4d1a-40c0-996c-7ef15d3c6696 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:29.092447 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f02392d1-4d1a-40c0-996c-7ef15d3c6696 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:29.092893 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f02392d1-4d1a-40c0-996c-7ef15d3c6696 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:29.093613 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f02392d1-4d1a-40c0-996c-7ef15d3c6696 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:29.094075 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f02392d1-4d1a-40c0-996c-7ef15d3c6696 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:29.094505 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f02392d1-4d1a-40c0-996c-7ef15d3c6696 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:29.225336 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f02392d1-4d1a-40c0-996c-7ef15d3c6696 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:29.233140 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f02392d1-4d1a-40c0-996c-7ef15d3c6696 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1518 microversion: 2.1 time: 0.152903 Sep 05 12:27:29.233710 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 359/712] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:29 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:29.350134 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2d8f3579-1d0e-466e-a8e7-132da79f80b1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:29.350751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2d8f3579-1d0e-466e-a8e7-132da79f80b1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:29.357520 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d8f3579-1d0e-466e-a8e7-132da79f80b1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:29.358006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d8f3579-1d0e-466e-a8e7-132da79f80b1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:29.358448 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d8f3579-1d0e-466e-a8e7-132da79f80b1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:29.359160 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d8f3579-1d0e-466e-a8e7-132da79f80b1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:29.359641 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d8f3579-1d0e-466e-a8e7-132da79f80b1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:29.360072 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d8f3579-1d0e-466e-a8e7-132da79f80b1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:29.437537 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-6c75aace-89d9-4ffc-8ba7-afb6d19082cc req-dd10a936-fb07-4edb-a721-bebf3ec33b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4181d872-fbd4-4b16-b8c2-d086dd1253b2", "name": "network-vif-unplugged", "status": "completed", "tag": "935d1954-274e-487a-b68a-696df548ac2a"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:27:29.448940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6c75aace-89d9-4ffc-8ba7-afb6d19082cc req-dd10a936-fb07-4edb-a721-bebf3ec33b7d service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:29.449490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6c75aace-89d9-4ffc-8ba7-afb6d19082cc req-dd10a936-fb07-4edb-a721-bebf3ec33b7d service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:29.450150 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6c75aace-89d9-4ffc-8ba7-afb6d19082cc req-dd10a936-fb07-4edb-a721-bebf3ec33b7d service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:29.462245 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.compute.server_external_events [req-6c75aace-89d9-4ffc-8ba7-afb6d19082cc req-dd10a936-fb07-4edb-a721-bebf3ec33b7d service nova] Unable to find a host for instance 4181d872-fbd4-4b16-b8c2-d086dd1253b2. Dropping event network-vif-unplugged {{(pid=120534) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 05 12:27:29.463292 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-6c75aace-89d9-4ffc-8ba7-afb6d19082cc req-dd10a936-fb07-4edb-a721-bebf3ec33b7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029597 Sep 05 12:27:29.464140 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 360/713] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 05 12:27:29.497580 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2d8f3579-1d0e-466e-a8e7-132da79f80b1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:29.505729 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2d8f3579-1d0e-466e-a8e7-132da79f80b1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1688 microversion: 2.1 time: 0.159702 Sep 05 12:27:29.506323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 354/714] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:29 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:29.803010 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-84195ae4-6918-4082-af54-9be9aeb587a7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:29.805998 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-84195ae4-6918-4082-af54-9be9aeb587a7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:29.812100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-84195ae4-6918-4082-af54-9be9aeb587a7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:29.812580 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-84195ae4-6918-4082-af54-9be9aeb587a7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:29.813019 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-84195ae4-6918-4082-af54-9be9aeb587a7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:29.813728 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-84195ae4-6918-4082-af54-9be9aeb587a7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:29.814189 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-84195ae4-6918-4082-af54-9be9aeb587a7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:29.814620 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-84195ae4-6918-4082-af54-9be9aeb587a7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:29.833071 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:29.846471 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-84195ae4-6918-4082-af54-9be9aeb587a7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047450 Sep 05 12:27:29.847053 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 361/715] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:27:29 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:27:29.914508 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6f4f2524-4517-4312-9e49-9f4c3eeb7a30 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:29.914997 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6f4f2524-4517-4312-9e49-9f4c3eeb7a30 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:29.921088 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f4f2524-4517-4312-9e49-9f4c3eeb7a30 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:29.921561 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f4f2524-4517-4312-9e49-9f4c3eeb7a30 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:29.921989 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f4f2524-4517-4312-9e49-9f4c3eeb7a30 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:29.922726 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f4f2524-4517-4312-9e49-9f4c3eeb7a30 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:29.923173 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f4f2524-4517-4312-9e49-9f4c3eeb7a30 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:29.923621 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f4f2524-4517-4312-9e49-9f4c3eeb7a30 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:29.948791 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6f4f2524-4517-4312-9e49-9f4c3eeb7a30 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Going to try to terminate instance {{(pid=120535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:27:29.951596 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:30.025866 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6f4f2524-4517-4312-9e49-9f4c3eeb7a30 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 204 len: 0 microversion: 2.1 time: 0.115460 Sep 05 12:27:30.030175 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 355/716] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:27:29 2022] DELETE /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:27:30.036652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-cb19bd88-6eec-4146-851a-c6dd63a660f4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:30.037260 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-cb19bd88-6eec-4146-851a-c6dd63a660f4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:30.049175 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cb19bd88-6eec-4146-851a-c6dd63a660f4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:30.049783 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cb19bd88-6eec-4146-851a-c6dd63a660f4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:30.050220 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cb19bd88-6eec-4146-851a-c6dd63a660f4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:30.050920 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cb19bd88-6eec-4146-851a-c6dd63a660f4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:30.051364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cb19bd88-6eec-4146-851a-c6dd63a660f4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:30.051982 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cb19bd88-6eec-4146-851a-c6dd63a660f4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:30.181714 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-cb19bd88-6eec-4146-851a-c6dd63a660f4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:30.189285 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-cb19bd88-6eec-4146-851a-c6dd63a660f4 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1674 microversion: 2.1 time: 0.158023 Sep 05 12:27:30.189841 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 362/717] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:30 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:30.258349 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-62924f59-76d7-4bc0-a9c3-28bd814bb622 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:30.259046 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-62924f59-76d7-4bc0-a9c3-28bd814bb622 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:30.265347 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62924f59-76d7-4bc0-a9c3-28bd814bb622 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:30.265825 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62924f59-76d7-4bc0-a9c3-28bd814bb622 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:30.266249 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62924f59-76d7-4bc0-a9c3-28bd814bb622 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:30.266929 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62924f59-76d7-4bc0-a9c3-28bd814bb622 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:30.267376 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62924f59-76d7-4bc0-a9c3-28bd814bb622 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:30.267834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62924f59-76d7-4bc0-a9c3-28bd814bb622 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:30.395411 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-62924f59-76d7-4bc0-a9c3-28bd814bb622 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:30.404439 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-62924f59-76d7-4bc0-a9c3-28bd814bb622 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1518 microversion: 2.1 time: 0.150914 Sep 05 12:27:30.404993 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 356/718] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:30 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:30.529604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9afa04e5-4412-47e2-9916-844004d38c15 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:30.530211 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9afa04e5-4412-47e2-9916-844004d38c15 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:30.536200 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9afa04e5-4412-47e2-9916-844004d38c15 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:30.536685 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9afa04e5-4412-47e2-9916-844004d38c15 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:30.537127 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9afa04e5-4412-47e2-9916-844004d38c15 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:30.537813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9afa04e5-4412-47e2-9916-844004d38c15 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:30.538268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9afa04e5-4412-47e2-9916-844004d38c15 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:30.538696 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9afa04e5-4412-47e2-9916-844004d38c15 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:30.663960 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9afa04e5-4412-47e2-9916-844004d38c15 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:30.671654 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9afa04e5-4412-47e2-9916-844004d38c15 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1688 microversion: 2.1 time: 0.146116 Sep 05 12:27:30.672410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 363/719] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:30 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1688 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:31.213448 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4e6c87e4-f41c-4f4c-8b65-e22339bddc52 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:31.214087 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4e6c87e4-f41c-4f4c-8b65-e22339bddc52 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:31.220099 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e6c87e4-f41c-4f4c-8b65-e22339bddc52 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:31.220577 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e6c87e4-f41c-4f4c-8b65-e22339bddc52 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:31.221008 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e6c87e4-f41c-4f4c-8b65-e22339bddc52 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:31.221736 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e6c87e4-f41c-4f4c-8b65-e22339bddc52 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:31.222184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e6c87e4-f41c-4f4c-8b65-e22339bddc52 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:31.222596 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4e6c87e4-f41c-4f4c-8b65-e22339bddc52 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:31.358624 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4e6c87e4-f41c-4f4c-8b65-e22339bddc52 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:31.366281 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4e6c87e4-f41c-4f4c-8b65-e22339bddc52 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1674 microversion: 2.1 time: 0.156866 Sep 05 12:27:31.367425 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 357/720] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:31 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:31.428217 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e1fc4d57-c04a-4803-bd75-979cd97f5487 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:31.429685 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e1fc4d57-c04a-4803-bd75-979cd97f5487 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:31.436771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e1fc4d57-c04a-4803-bd75-979cd97f5487 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:31.437274 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e1fc4d57-c04a-4803-bd75-979cd97f5487 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:31.437826 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e1fc4d57-c04a-4803-bd75-979cd97f5487 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:31.438478 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e1fc4d57-c04a-4803-bd75-979cd97f5487 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:31.439210 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e1fc4d57-c04a-4803-bd75-979cd97f5487 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:31.439647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e1fc4d57-c04a-4803-bd75-979cd97f5487 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:31.581055 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e1fc4d57-c04a-4803-bd75-979cd97f5487 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:31.590444 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e1fc4d57-c04a-4803-bd75-979cd97f5487 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1518 microversion: 2.1 time: 0.166070 Sep 05 12:27:31.591035 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 364/721] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:31 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:31.695112 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-dc95c382-20e3-4627-8855-e8a14cbfe7aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:31.695922 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-dc95c382-20e3-4627-8855-e8a14cbfe7aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:31.703154 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc95c382-20e3-4627-8855-e8a14cbfe7aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:31.703681 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc95c382-20e3-4627-8855-e8a14cbfe7aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:31.704695 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc95c382-20e3-4627-8855-e8a14cbfe7aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:31.704840 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc95c382-20e3-4627-8855-e8a14cbfe7aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:31.705262 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc95c382-20e3-4627-8855-e8a14cbfe7aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:31.705714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc95c382-20e3-4627-8855-e8a14cbfe7aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:31.935066 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-dc95c382-20e3-4627-8855-e8a14cbfe7aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:31.948491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-dc95c382-20e3-4627-8855-e8a14cbfe7aa tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1688 microversion: 2.1 time: 0.257227 Sep 05 12:27:31.949165 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 358/722] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:31 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1688 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:32.392465 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-47b7a131-cbf6-4c0d-a97f-30691a571347 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:32.393588 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-47b7a131-cbf6-4c0d-a97f-30691a571347 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:32.401735 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-47b7a131-cbf6-4c0d-a97f-30691a571347 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:32.402297 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-47b7a131-cbf6-4c0d-a97f-30691a571347 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:32.403104 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-47b7a131-cbf6-4c0d-a97f-30691a571347 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:32.404512 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-47b7a131-cbf6-4c0d-a97f-30691a571347 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:32.405202 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-47b7a131-cbf6-4c0d-a97f-30691a571347 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:32.405724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-47b7a131-cbf6-4c0d-a97f-30691a571347 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:32.615696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-97c401f4-43ba-4a7b-a9f2-93b40ecb299b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:32.617504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-97c401f4-43ba-4a7b-a9f2-93b40ecb299b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:32.631233 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97c401f4-43ba-4a7b-a9f2-93b40ecb299b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:32.631599 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97c401f4-43ba-4a7b-a9f2-93b40ecb299b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:32.632038 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97c401f4-43ba-4a7b-a9f2-93b40ecb299b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:32.632819 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97c401f4-43ba-4a7b-a9f2-93b40ecb299b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:32.633282 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97c401f4-43ba-4a7b-a9f2-93b40ecb299b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:32.633709 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97c401f4-43ba-4a7b-a9f2-93b40ecb299b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:32.694078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-47b7a131-cbf6-4c0d-a97f-30691a571347 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:32.704064 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-47b7a131-cbf6-4c0d-a97f-30691a571347 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1674 microversion: 2.1 time: 0.317515 Sep 05 12:27:32.704659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 365/723] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:32 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1674 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:32.957698 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-97c401f4-43ba-4a7b-a9f2-93b40ecb299b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:32.975932 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-97c401f4-43ba-4a7b-a9f2-93b40ecb299b tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1520 microversion: 2.1 time: 0.364774 Sep 05 12:27:32.977634 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-09e57cb6-ad12-4f19-ad5f-af8168900deb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:32.978686 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-09e57cb6-ad12-4f19-ad5f-af8168900deb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:32.999947 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 359/724] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:32 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1520 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:33.003988 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-09e57cb6-ad12-4f19-ad5f-af8168900deb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:33.005024 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-09e57cb6-ad12-4f19-ad5f-af8168900deb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:33.005824 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-09e57cb6-ad12-4f19-ad5f-af8168900deb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:33.007099 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-09e57cb6-ad12-4f19-ad5f-af8168900deb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:33.014031 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-09e57cb6-ad12-4f19-ad5f-af8168900deb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:33.014621 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-09e57cb6-ad12-4f19-ad5f-af8168900deb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:33.016196 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-2a00d157-5dbd-4fab-b2fb-4c9f5fa9d38e req-5cae285b-081d-416a-93a4-1b6aaa4e33c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64534ca-02f1-4369-94ac-1b50a063b870", "name": "network-vif-deleted", "tag": "6949e5c9-4d88-4c61-a9fc-3ae9edcff7ae"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:27:33.036461 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-2a00d157-5dbd-4fab-b2fb-4c9f5fa9d38e req-5cae285b-081d-416a-93a4-1b6aaa4e33c4 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:33.036992 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-2a00d157-5dbd-4fab-b2fb-4c9f5fa9d38e req-5cae285b-081d-416a-93a4-1b6aaa4e33c4 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:33.065347 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-2a00d157-5dbd-4fab-b2fb-4c9f5fa9d38e req-5cae285b-081d-416a-93a4-1b6aaa4e33c4 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:33.090925 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-2a00d157-5dbd-4fab-b2fb-4c9f5fa9d38e req-5cae285b-081d-416a-93a4-1b6aaa4e33c4 service nova] Creating event network-vif-deleted:6949e5c9-4d88-4c61-a9fc-3ae9edcff7ae for instance f64534ca-02f1-4369-94ac-1b50a063b870 on hv-cinder-85518 Sep 05 12:27:33.099037 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-2a00d157-5dbd-4fab-b2fb-4c9f5fa9d38e req-5cae285b-081d-416a-93a4-1b6aaa4e33c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086635 Sep 05 12:27:33.102226 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 360/725] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:33.355385 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-09e57cb6-ad12-4f19-ad5f-af8168900deb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:33.370952 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-09e57cb6-ad12-4f19-ad5f-af8168900deb tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 200 len: 1621 microversion: 2.1 time: 0.400822 Sep 05 12:27:33.371896 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 366/726] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:32 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 1621 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:33.439937 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-e467183f-8acc-40e0-a0d0-39de88c62af9 req-faff6a5a-f5d9-4188-96d4-85587f898889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78eb7b3-fb70-404b-b598-c80dd26f2827", "name": "network-vif-deleted", "tag": "c7568900-c23a-4731-a0b3-57f3e306773b"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:27:33.450749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-e467183f-8acc-40e0-a0d0-39de88c62af9 req-faff6a5a-f5d9-4188-96d4-85587f898889 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:33.451309 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-e467183f-8acc-40e0-a0d0-39de88c62af9 req-faff6a5a-f5d9-4188-96d4-85587f898889 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:33.451821 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-e467183f-8acc-40e0-a0d0-39de88c62af9 req-faff6a5a-f5d9-4188-96d4-85587f898889 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:33.463579 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-e467183f-8acc-40e0-a0d0-39de88c62af9 req-faff6a5a-f5d9-4188-96d4-85587f898889 service nova] Creating event network-vif-deleted:c7568900-c23a-4731-a0b3-57f3e306773b for instance b78eb7b3-fb70-404b-b598-c80dd26f2827 on hv-cinder-85518 Sep 05 12:27:33.468624 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-e467183f-8acc-40e0-a0d0-39de88c62af9 req-faff6a5a-f5d9-4188-96d4-85587f898889 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033057 Sep 05 12:27:33.469348 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 361/727] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:33.739711 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-157a4118-535e-471a-b179-93236920e991 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:33.744416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-157a4118-535e-471a-b179-93236920e991 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:33.765297 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-157a4118-535e-471a-b179-93236920e991 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:33.766560 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-157a4118-535e-471a-b179-93236920e991 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:33.767264 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-157a4118-535e-471a-b179-93236920e991 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:33.768248 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-157a4118-535e-471a-b179-93236920e991 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:33.769087 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-157a4118-535e-471a-b179-93236920e991 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:33.769779 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-157a4118-535e-471a-b179-93236920e991 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:33.830404 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-157a4118-535e-471a-b179-93236920e991 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:33.831246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-157a4118-535e-471a-b179-93236920e991 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:33.831993 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-157a4118-535e-471a-b179-93236920e991 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:33.842497 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.objects.instance [None req-157a4118-535e-471a-b179-93236920e991 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lazy-loading 'fault' on Instance uuid b78eb7b3-fb70-404b-b598-c80dd26f2827 {{(pid=120534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:27:33.907064 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-157a4118-535e-471a-b179-93236920e991 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:33.924494 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-157a4118-535e-471a-b179-93236920e991 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 200 len: 1327 microversion: 2.1 time: 0.191615 Sep 05 12:27:33.925327 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 367/728] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:33 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 1327 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:34.022092 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e336f784-a185-4827-833f-9a24c4738d35 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:34.022893 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e336f784-a185-4827-833f-9a24c4738d35 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:34.030131 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e336f784-a185-4827-833f-9a24c4738d35 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:34.030423 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e336f784-a185-4827-833f-9a24c4738d35 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:34.031056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e336f784-a185-4827-833f-9a24c4738d35 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:34.031781 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e336f784-a185-4827-833f-9a24c4738d35 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:34.032240 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e336f784-a185-4827-833f-9a24c4738d35 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:34.032660 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e336f784-a185-4827-833f-9a24c4738d35 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:34.190478 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e336f784-a185-4827-833f-9a24c4738d35 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:34.199670 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e336f784-a185-4827-833f-9a24c4738d35 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1576 microversion: 2.1 time: 0.181921 Sep 05 12:27:34.200390 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 362/729] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:34 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:34.395916 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4aeb0a47-ba88-4910-9fef-dbe082c3ae51 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:34.397041 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4aeb0a47-ba88-4910-9fef-dbe082c3ae51 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: f64534ca-02f1-4369-94ac-1b50a063b870] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:34.410745 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4aeb0a47-ba88-4910-9fef-dbe082c3ae51 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:34.411544 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4aeb0a47-ba88-4910-9fef-dbe082c3ae51 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:34.412244 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4aeb0a47-ba88-4910-9fef-dbe082c3ae51 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:34.413444 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4aeb0a47-ba88-4910-9fef-dbe082c3ae51 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:34.414830 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4aeb0a47-ba88-4910-9fef-dbe082c3ae51 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:34.415498 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4aeb0a47-ba88-4910-9fef-dbe082c3ae51 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:34.443135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-4aeb0a47-ba88-4910-9fef-dbe082c3ae51 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] HTTP exception thrown: Instance f64534ca-02f1-4369-94ac-1b50a063b870 could not be found. Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4aeb0a47-ba88-4910-9fef-dbe082c3ae51 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Request method failure captured: Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 HTTP/1.1 Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFemrRjsZ90kVZGEYqus02Ie2QEuWipxU6VktRw18WSg3Fpgy9K9kJquxI27KqHdB07zJsep0zf_MlmvFbu20x7ARqbxgkdDrmFUuOBlSs7bfiiMuDgXotQH7Nd3_qhrMVZfo6sO74REUpDPYIGAv4U70gu44RmLra0MEy0GinSKViEY Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 938f765828c545a8840a6983bc5d9e6d Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:27:34.446684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:27:34.449598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_938f765828c545a8840a6983bc5d9e6d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/938f765828c545a8840a6983bc5d9e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/938f765828c545a8840a6983bc5d9e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/938f765828c545a8840a6983bc5d9e6d"}]}] Sep 05 12:27:34.449598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:27:34.449598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 938f765828c545a8840a6983bc5d9e6d Sep 05 12:27:34.449598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:27:34.449598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-ServerRescueNegativeTestJSON-798904028-project Sep 05 12:27:34.449598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:27:34.449598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:27:34.449598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: ff0999bd21bf4db5981053922200be2a Sep 05 12:27:34.449598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-ServerRescueNegativeTestJSON-798904028-project Sep 05 12:27:34.449598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:27:34.449598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance f64534ca-02f1-4369-94ac-1b50a063b870 could not be found. Sep 05 12:27:34.449598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': 'f64534ca-02f1-4369-94ac-1b50a063b870'} Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f64534ca-02f1-4369-94ac-1b50a063b870 could not be found. Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:27:34.450517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f64534ca-02f1-4369-94ac-1b50a063b870 could not be found. Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f64534ca-02f1-4369-94ac-1b50a063b870 could not be found. Sep 05 12:27:34.452051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:34.453236 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4aeb0a47-ba88-4910-9fef-dbe082c3ae51 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Returning 404 to user: Instance f64534ca-02f1-4369-94ac-1b50a063b870 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:27:34.453236 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4aeb0a47-ba88-4910-9fef-dbe082c3ae51 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870" status: 404 len: 111 microversion: 2.1 time: 0.061608 Sep 05 12:27:34.454067 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 368/730] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:34 2022] GET /compute/v2.1/servers/f64534ca-02f1-4369-94ac-1b50a063b870 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:27:34.462583 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9a748b1d-8997-4651-a3c2-f1a45d6bf89e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '.version_select at 0x7fba4b7de670>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:34.486290 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9a748b1d-8997-4651-a3c2-f1a45d6bf89e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-612182563" status: 202 len: 0 microversion: 2.1 time: 0.028418 Sep 05 12:27:34.491055 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 363/731] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Sep 5 12:27:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-612182563 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:27:34.950397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-dcc10d25-54c5-4cb6-85ba-805e11b3e176 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:34.951162 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-dcc10d25-54c5-4cb6-85ba-805e11b3e176 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:34.966792 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dcc10d25-54c5-4cb6-85ba-805e11b3e176 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:34.967305 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dcc10d25-54c5-4cb6-85ba-805e11b3e176 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:34.967953 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dcc10d25-54c5-4cb6-85ba-805e11b3e176 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:34.968923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dcc10d25-54c5-4cb6-85ba-805e11b3e176 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:34.969774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dcc10d25-54c5-4cb6-85ba-805e11b3e176 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:34.970363 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dcc10d25-54c5-4cb6-85ba-805e11b3e176 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:34.985744 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-dcc10d25-54c5-4cb6-85ba-805e11b3e176 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] HTTP exception thrown: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-dcc10d25-54c5-4cb6-85ba-805e11b3e176 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Request method failure captured: Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 HTTP/1.1 Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFek5WORsXLudpQ0z6oCEAL-sJ8JqLDJQTDN2Jbg2D5DgFRQefamcZqj3pUvijm9sZEZ9Y_qSVRGehIFsemBFqG4MBNma5scm6u2ndD2iDYnQQgWsHgSv9O7PHEvwX2HK08452P96EQby2qocan4B1On-pr39CyyrGFeMpsV99E-5Rs0 Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 8f21d577dc6d44a7b05ee0a0232bed6c Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:27:34.987780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:27:34.989410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f21d577dc6d44a7b05ee0a0232bed6c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f21d577dc6d44a7b05ee0a0232bed6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f21d577dc6d44a7b05ee0a0232bed6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f21d577dc6d44a7b05ee0a0232bed6c"}]}] Sep 05 12:27:34.989410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:27:34.989410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 8f21d577dc6d44a7b05ee0a0232bed6c Sep 05 12:27:34.989410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:27:34.989410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-AttachVolumeTestJSON-656335981-project Sep 05 12:27:34.989410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:27:34.989410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:27:34.989410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 45bd61574c6c4ebb9d6fe0c87228065f Sep 05 12:27:34.989410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-AttachVolumeTestJSON-656335981-project Sep 05 12:27:34.989410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:27:34.989410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:27:34.989410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': 'b78eb7b3-fb70-404b-b598-c80dd26f2827'} Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:27:34.990519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:27:34.992025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:34.993187 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-dcc10d25-54c5-4cb6-85ba-805e11b3e176 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Returning 404 to user: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:27:34.993187 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-dcc10d25-54c5-4cb6-85ba-805e11b3e176 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 404 len: 111 microversion: 2.1 time: 0.044476 Sep 05 12:27:34.993187 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 369/732] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:34 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:27:34.998983 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b9d34064-9c35-4790-ba78-e4c8464160e6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '.version_select at 0x7fba4b80aca0>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:35.020680 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b9d34064-9c35-4790-ba78-e4c8464160e6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922529357" status: 202 len: 0 microversion: 2.1 time: 0.025891 Sep 05 12:27:35.021263 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 364/733] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Sep 5 12:27:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922529357 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:27:35.222973 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-cbeae13d-567d-4354-8dba-4ce140044fc2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:35.223505 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-cbeae13d-567d-4354-8dba-4ce140044fc2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:35.229751 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cbeae13d-567d-4354-8dba-4ce140044fc2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:35.230247 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cbeae13d-567d-4354-8dba-4ce140044fc2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:35.230744 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cbeae13d-567d-4354-8dba-4ce140044fc2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:35.231916 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cbeae13d-567d-4354-8dba-4ce140044fc2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:35.232762 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cbeae13d-567d-4354-8dba-4ce140044fc2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:35.233248 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cbeae13d-567d-4354-8dba-4ce140044fc2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:35.497595 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-cbeae13d-567d-4354-8dba-4ce140044fc2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:35.508616 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-cbeae13d-567d-4354-8dba-4ce140044fc2 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1576 microversion: 2.1 time: 0.289688 Sep 05 12:27:35.510893 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 370/734] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:35 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1576 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:35.896874 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a536183e-6c32-4ad6-8d7f-191f7cc0f3d0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Action: 'create', calling method: .version_select at 0x7fba4b7eeb80>, body: {"keypair": {"name": "tempest-keypair-402053730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOQ55SUCxFekaEiybfjfXa62I+vFVcwM39Y5Q6sXXbKnEqPH06czUw5oGMveOKzAkmk43OBCibxXfnNCHDMzqB9CIalbf6pHQhktwB4iX9J0R+D3PafMS5aKGvkgv312g=="}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:27:35.914924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-a536183e-6c32-4ad6-8d7f-191f7cc0f3d0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Getting quotas for project 8f21d577dc6d44a7b05ee0a0232bed6c. Resources: {'key_pairs'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:27:35.918724 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-a536183e-6c32-4ad6-8d7f-191f7cc0f3d0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Getting quotas for user 45bd61574c6c4ebb9d6fe0c87228065f and project 8f21d577dc6d44a7b05ee0a0232bed6c. Resources: {'key_pairs'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:27:35.944313 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a536183e-6c32-4ad6-8d7f-191f7cc0f3d0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051814 Sep 05 12:27:35.945237 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 365/735] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Sep 5 12:27:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:36.553965 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-6fcb7d1c-7d34-49a1-b63f-57cd35ede9d5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:36.555632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-6fcb7d1c-7d34-49a1-b63f-57cd35ede9d5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:36.563946 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6fcb7d1c-7d34-49a1-b63f-57cd35ede9d5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:36.564561 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6fcb7d1c-7d34-49a1-b63f-57cd35ede9d5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:36.565005 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6fcb7d1c-7d34-49a1-b63f-57cd35ede9d5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:36.565783 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6fcb7d1c-7d34-49a1-b63f-57cd35ede9d5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:36.566243 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6fcb7d1c-7d34-49a1-b63f-57cd35ede9d5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:36.566676 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6fcb7d1c-7d34-49a1-b63f-57cd35ede9d5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:36.728855 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6fcb7d1c-7d34-49a1-b63f-57cd35ede9d5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:36.737224 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-6fcb7d1c-7d34-49a1-b63f-57cd35ede9d5 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1576 microversion: 2.1 time: 0.190559 Sep 05 12:27:36.738011 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 371/736] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:36 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:37.268822 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-132967578", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d576ead4-1f78-4a93-bce5-d3b879fdb32a"}], "security_groups": [{"name": "tempest-securitygroup--234779323"}], "key_name": "tempest-keypair-402053730", "user_data": "}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:27:37.378269 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.network.neutron [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] validate_networks() for [('d576ead4-1f78-4a93-bce5-d3b879fdb32a', None, None, None, None, None)] {{(pid=120535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:27:37.712937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-cbad314b-c1c0-4beb-923f-cc2b862d0816 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:37.713506 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-cbad314b-c1c0-4beb-923f-cc2b862d0816 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:37.720511 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cbad314b-c1c0-4beb-923f-cc2b862d0816 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:37.720752 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cbad314b-c1c0-4beb-923f-cc2b862d0816 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:37.721188 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cbad314b-c1c0-4beb-923f-cc2b862d0816 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:37.721888 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cbad314b-c1c0-4beb-923f-cc2b862d0816 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:37.722341 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cbad314b-c1c0-4beb-923f-cc2b862d0816 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:37.722761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cbad314b-c1c0-4beb-923f-cc2b862d0816 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:37.751134 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-cbad314b-c1c0-4beb-923f-cc2b862d0816 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Going to try to terminate instance {{(pid=120534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:27:37.761338 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Flavor limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:27:37.761811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Image limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:27:37.762245 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Flavor pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:27:37.762655 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Image pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:27:37.763064 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:27:37.774013 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:37.774494 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:37.774930 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:37.775710 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:37.776177 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:37.776599 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:37.795234 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Getting quotas for project 8f21d577dc6d44a7b05ee0a0232bed6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:27:37.800377 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Getting quotas for user 45bd61574c6c4ebb9d6fe0c87228065f and project 8f21d577dc6d44a7b05ee0a0232bed6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:27:37.814609 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Going to run 1 instances... {{(pid=120535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:27:37.817727 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:27:37.841613 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-cbad314b-c1c0-4beb-923f-cc2b862d0816 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 204 len: 0 microversion: 2.1 time: 0.132425 Sep 05 12:27:37.842504 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 372/737] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:27:37 2022] DELETE /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 05 12:27:37.848706 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e87805b0-0b49-413a-b682-5b5330f18783 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:37.849447 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e87805b0-0b49-413a-b682-5b5330f18783 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:37.855817 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e87805b0-0b49-413a-b682-5b5330f18783 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:37.856308 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e87805b0-0b49-413a-b682-5b5330f18783 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:37.856827 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e87805b0-0b49-413a-b682-5b5330f18783 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:37.859204 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e87805b0-0b49-413a-b682-5b5330f18783 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:37.859204 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e87805b0-0b49-413a-b682-5b5330f18783 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:37.859204 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e87805b0-0b49-413a-b682-5b5330f18783 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:37.879406 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6bb53265-4fce-4e43-aff9-0efd8636fd0a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.615793 Sep 05 12:27:37.880568 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 366/738] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:27:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:27:37.889993 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e2727ff2-2305-4296-9f27-72e182cb03fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:37.891137 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e2727ff2-2305-4296-9f27-72e182cb03fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:37.899042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e2727ff2-2305-4296-9f27-72e182cb03fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:37.899588 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e2727ff2-2305-4296-9f27-72e182cb03fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:37.900241 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e2727ff2-2305-4296-9f27-72e182cb03fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:37.900977 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e2727ff2-2305-4296-9f27-72e182cb03fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:37.901607 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e2727ff2-2305-4296-9f27-72e182cb03fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:37.902199 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e2727ff2-2305-4296-9f27-72e182cb03fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:38.010788 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e87805b0-0b49-413a-b682-5b5330f18783 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:38.020032 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e87805b0-0b49-413a-b682-5b5330f18783 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1576 microversion: 2.1 time: 0.176043 Sep 05 12:27:38.020630 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 373/739] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:37 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:38.035322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-52d78ecd-86f7-4578-8a01-6b5dd9792d9c tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:38.036822 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-52d78ecd-86f7-4578-8a01-6b5dd9792d9c tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:38.069201 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e2727ff2-2305-4296-9f27-72e182cb03fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:38.088539 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e2727ff2-2305-4296-9f27-72e182cb03fe tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1507 microversion: 2.1 time: 0.203788 Sep 05 12:27:38.089382 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 367/740] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:37 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:38.106430 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-52d78ecd-86f7-4578-8a01-6b5dd9792d9c tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:38.114147 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-52d78ecd-86f7-4578-8a01-6b5dd9792d9c tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1236 microversion: 2.1 time: 0.083046 Sep 05 12:27:38.115353 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 374/741] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:38 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1236 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:39.044740 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-503b9f81-c991-4760-9e40-beb2e1342dd6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:39.046202 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-503b9f81-c991-4760-9e40-beb2e1342dd6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:39.054096 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-503b9f81-c991-4760-9e40-beb2e1342dd6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:39.054634 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-503b9f81-c991-4760-9e40-beb2e1342dd6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:39.055078 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-503b9f81-c991-4760-9e40-beb2e1342dd6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:39.055821 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-503b9f81-c991-4760-9e40-beb2e1342dd6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:39.056285 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-503b9f81-c991-4760-9e40-beb2e1342dd6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:39.057071 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-503b9f81-c991-4760-9e40-beb2e1342dd6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:39.112040 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d95a7974-1679-4e91-8b73-b6ab30600bd1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:39.112751 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d95a7974-1679-4e91-8b73-b6ab30600bd1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:39.121395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d95a7974-1679-4e91-8b73-b6ab30600bd1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:39.121997 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d95a7974-1679-4e91-8b73-b6ab30600bd1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:39.122692 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d95a7974-1679-4e91-8b73-b6ab30600bd1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:39.123656 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d95a7974-1679-4e91-8b73-b6ab30600bd1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:39.124330 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d95a7974-1679-4e91-8b73-b6ab30600bd1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:39.124833 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d95a7974-1679-4e91-8b73-b6ab30600bd1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:39.202001 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-503b9f81-c991-4760-9e40-beb2e1342dd6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:39.211194 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-503b9f81-c991-4760-9e40-beb2e1342dd6 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1576 microversion: 2.1 time: 0.169828 Sep 05 12:27:39.211894 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 368/742] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:39 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:39.216661 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-21a95cc2-ef66-4f32-87f9-44f186dc067d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:39.217347 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-21a95cc2-ef66-4f32-87f9-44f186dc067d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:39.229077 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21a95cc2-ef66-4f32-87f9-44f186dc067d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:39.229865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21a95cc2-ef66-4f32-87f9-44f186dc067d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:39.230371 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21a95cc2-ef66-4f32-87f9-44f186dc067d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:39.231148 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21a95cc2-ef66-4f32-87f9-44f186dc067d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:39.231773 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21a95cc2-ef66-4f32-87f9-44f186dc067d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:39.232202 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21a95cc2-ef66-4f32-87f9-44f186dc067d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:39.304133 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-21a95cc2-ef66-4f32-87f9-44f186dc067d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:39.329123 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-21a95cc2-ef66-4f32-87f9-44f186dc067d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1288 microversion: 2.1 time: 0.115914 Sep 05 12:27:39.329930 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 369/743] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:39 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1288 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:39.360500 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d95a7974-1679-4e91-8b73-b6ab30600bd1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:39.368417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d95a7974-1679-4e91-8b73-b6ab30600bd1 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1507 microversion: 2.1 time: 0.260424 Sep 05 12:27:39.381672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 375/744] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:39 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:39.400581 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-5a92be19-c9b0-4b85-96d0-b2fb9d9dcd7c req-a05e61ea-269f-47eb-9e0a-1536981e209e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d72a6ee-e4bf-4eca-afd2-0047a95d57a5", "name": "network-vif-deleted", "tag": "7ec54931-635e-4001-b648-0b385ff9376b"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:27:39.411775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-5a92be19-c9b0-4b85-96d0-b2fb9d9dcd7c req-a05e61ea-269f-47eb-9e0a-1536981e209e service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:39.412691 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-5a92be19-c9b0-4b85-96d0-b2fb9d9dcd7c req-a05e61ea-269f-47eb-9e0a-1536981e209e service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:39.413332 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-5a92be19-c9b0-4b85-96d0-b2fb9d9dcd7c req-a05e61ea-269f-47eb-9e0a-1536981e209e service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:39.427134 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-5a92be19-c9b0-4b85-96d0-b2fb9d9dcd7c req-a05e61ea-269f-47eb-9e0a-1536981e209e service nova] Creating event network-vif-deleted:7ec54931-635e-4001-b648-0b385ff9376b for instance 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 on hv-cinder-85518 Sep 05 12:27:39.432368 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-5a92be19-c9b0-4b85-96d0-b2fb9d9dcd7c req-a05e61ea-269f-47eb-9e0a-1536981e209e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036322 Sep 05 12:27:39.433191 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 370/745] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:40.237668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8a4f850e-f2b6-4254-a242-5da6849c2978 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:40.238363 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-8a4f850e-f2b6-4254-a242-5da6849c2978 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:40.246864 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8a4f850e-f2b6-4254-a242-5da6849c2978 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:40.247366 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8a4f850e-f2b6-4254-a242-5da6849c2978 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:40.247846 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8a4f850e-f2b6-4254-a242-5da6849c2978 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:40.248585 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8a4f850e-f2b6-4254-a242-5da6849c2978 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:40.249044 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8a4f850e-f2b6-4254-a242-5da6849c2978 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:40.249530 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8a4f850e-f2b6-4254-a242-5da6849c2978 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:40.357925 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-779802e9-9911-40e1-9508-0bfdf53ba8e2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:40.358632 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-779802e9-9911-40e1-9508-0bfdf53ba8e2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:40.365408 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-779802e9-9911-40e1-9508-0bfdf53ba8e2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:40.365906 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-779802e9-9911-40e1-9508-0bfdf53ba8e2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:40.366344 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-779802e9-9911-40e1-9508-0bfdf53ba8e2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:40.367780 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-779802e9-9911-40e1-9508-0bfdf53ba8e2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:40.368452 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-779802e9-9911-40e1-9508-0bfdf53ba8e2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:40.368888 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-779802e9-9911-40e1-9508-0bfdf53ba8e2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:40.444655 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-779802e9-9911-40e1-9508-0bfdf53ba8e2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:40.454014 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-779802e9-9911-40e1-9508-0bfdf53ba8e2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1294 microversion: 2.1 time: 0.100717 Sep 05 12:27:40.454530 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 371/746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:40 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:40.460097 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8a4f850e-f2b6-4254-a242-5da6849c2978 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:40.472273 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8a4f850e-f2b6-4254-a242-5da6849c2978 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1576 microversion: 2.1 time: 0.238605 Sep 05 12:27:40.473104 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 376/747] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:40 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1576 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:40.473808 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-017e0a25-aeca-4ef0-8981-ec26bf51ec5e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:40.474588 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-017e0a25-aeca-4ef0-8981-ec26bf51ec5e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:40.482660 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-017e0a25-aeca-4ef0-8981-ec26bf51ec5e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:40.483143 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-017e0a25-aeca-4ef0-8981-ec26bf51ec5e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:40.483603 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-017e0a25-aeca-4ef0-8981-ec26bf51ec5e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:40.484301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-017e0a25-aeca-4ef0-8981-ec26bf51ec5e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:40.484749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-017e0a25-aeca-4ef0-8981-ec26bf51ec5e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:40.485239 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-017e0a25-aeca-4ef0-8981-ec26bf51ec5e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:40.517974 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:40.523644 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-017e0a25-aeca-4ef0-8981-ec26bf51ec5e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:40.524370 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-017e0a25-aeca-4ef0-8981-ec26bf51ec5e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:40.524801 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-017e0a25-aeca-4ef0-8981-ec26bf51ec5e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:40.525258 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-017e0a25-aeca-4ef0-8981-ec26bf51ec5e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lazy-loading 'fault' on Instance uuid 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:27:40.575175 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-017e0a25-aeca-4ef0-8981-ec26bf51ec5e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:40.583889 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-017e0a25-aeca-4ef0-8981-ec26bf51ec5e tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 200 len: 1312 microversion: 2.1 time: 0.128096 Sep 05 12:27:40.584478 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 372/748] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:40 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 1312 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:41.449023 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-2231a79a-39d1-482d-90ef-66a1c6ff61a6 req-db77c53b-daae-47eb-ab56-ef4421735fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "887dcf0e-194f-41f2-bfa6-5e8e41fc24f6", "tag": "fb563ae1-134e-4704-a744-d3c52eb2c338"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:27:41.458841 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-2231a79a-39d1-482d-90ef-66a1c6ff61a6 req-db77c53b-daae-47eb-ab56-ef4421735fca service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:41.459319 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-2231a79a-39d1-482d-90ef-66a1c6ff61a6 req-db77c53b-daae-47eb-ab56-ef4421735fca service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:41.459771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-2231a79a-39d1-482d-90ef-66a1c6ff61a6 req-db77c53b-daae-47eb-ab56-ef4421735fca service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:41.471084 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-2231a79a-39d1-482d-90ef-66a1c6ff61a6 req-db77c53b-daae-47eb-ab56-ef4421735fca service nova] Creating event network-changed:fb563ae1-134e-4704-a744-d3c52eb2c338 for instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 on hv-cinder-85518 Sep 05 12:27:41.476836 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-2231a79a-39d1-482d-90ef-66a1c6ff61a6 req-db77c53b-daae-47eb-ab56-ef4421735fca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031377 Sep 05 12:27:41.477592 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 377/749] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:27:41.478706 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-bcb4834f-e4d6-41b4-a264-acc4aef84682 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:41.480039 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-bcb4834f-e4d6-41b4-a264-acc4aef84682 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:41.486544 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bcb4834f-e4d6-41b4-a264-acc4aef84682 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:41.487025 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bcb4834f-e4d6-41b4-a264-acc4aef84682 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:41.487459 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bcb4834f-e4d6-41b4-a264-acc4aef84682 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:41.488198 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bcb4834f-e4d6-41b4-a264-acc4aef84682 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:41.488658 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bcb4834f-e4d6-41b4-a264-acc4aef84682 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:41.489080 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bcb4834f-e4d6-41b4-a264-acc4aef84682 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:41.503217 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c192ca67-8bfe-441a-aa27-0abf29f1418e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:41.503957 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c192ca67-8bfe-441a-aa27-0abf29f1418e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:41.510232 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c192ca67-8bfe-441a-aa27-0abf29f1418e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:41.510728 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c192ca67-8bfe-441a-aa27-0abf29f1418e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:41.511170 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c192ca67-8bfe-441a-aa27-0abf29f1418e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:41.511904 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c192ca67-8bfe-441a-aa27-0abf29f1418e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:41.512366 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c192ca67-8bfe-441a-aa27-0abf29f1418e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:41.512797 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c192ca67-8bfe-441a-aa27-0abf29f1418e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:41.626270 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-bcb4834f-e4d6-41b4-a264-acc4aef84682 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:41.633987 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-bcb4834f-e4d6-41b4-a264-acc4aef84682 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1361 microversion: 2.1 time: 0.159585 Sep 05 12:27:41.634571 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 373/750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:41 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:41.639199 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0b2eac56-80f0-4bfe-874a-16e76d0713dc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:41.639863 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0b2eac56-80f0-4bfe-874a-16e76d0713dc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:41.646592 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b2eac56-80f0-4bfe-874a-16e76d0713dc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:41.647088 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b2eac56-80f0-4bfe-874a-16e76d0713dc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:41.647547 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b2eac56-80f0-4bfe-874a-16e76d0713dc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:41.648308 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b2eac56-80f0-4bfe-874a-16e76d0713dc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:41.648771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b2eac56-80f0-4bfe-874a-16e76d0713dc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:41.649213 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b2eac56-80f0-4bfe-874a-16e76d0713dc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:41.657318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c192ca67-8bfe-441a-aa27-0abf29f1418e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:41.665859 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-0b2eac56-80f0-4bfe-874a-16e76d0713dc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] HTTP exception thrown: Instance 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 could not be found. Sep 05 12:27:41.666187 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c192ca67-8bfe-441a-aa27-0abf29f1418e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1576 microversion: 2.1 time: 0.167130 Sep 05 12:27:41.666767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 378/751] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:41 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0b2eac56-80f0-4bfe-874a-16e76d0713dc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Request method failure captured: Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 HTTP/1.1 Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFemrRjsZ90kVZGEYqus02Ie2QEuWipxU6VktRw18WSg3Fpgy9K9kJquxI27KqHdB07zJsep0zf_MlmvFbu20x7ARqbxgkdDrmFUuOBlSs7bfiiMuDgXotQH7Nd3_qhrMVZfo6sO74REUpDPYIGAv4U70gu44RmLra0MEy0GinSKViEY Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 938f765828c545a8840a6983bc5d9e6d Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:27:41.669826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:27:41.671495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_938f765828c545a8840a6983bc5d9e6d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/938f765828c545a8840a6983bc5d9e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/938f765828c545a8840a6983bc5d9e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/938f765828c545a8840a6983bc5d9e6d"}]}] Sep 05 12:27:41.671495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:27:41.671495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 938f765828c545a8840a6983bc5d9e6d Sep 05 12:27:41.671495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:27:41.671495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-ServerRescueNegativeTestJSON-798904028-project Sep 05 12:27:41.671495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:27:41.671495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:27:41.671495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: ff0999bd21bf4db5981053922200be2a Sep 05 12:27:41.671495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-ServerRescueNegativeTestJSON-798904028-project Sep 05 12:27:41.671495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:27:41.671495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 could not be found. Sep 05 12:27:41.671495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '6d72a6ee-e4bf-4eca-afd2-0047a95d57a5'} Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 could not be found. Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:27:41.672469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 could not be found. Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 could not be found. Sep 05 12:27:41.673941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:27:41.675323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0b2eac56-80f0-4bfe-874a-16e76d0713dc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Returning 404 to user: Instance 6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:27:41.675323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0b2eac56-80f0-4bfe-874a-16e76d0713dc tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5" status: 404 len: 111 microversion: 2.1 time: 0.033582 Sep 05 12:27:41.675323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 374/752] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:41 2022] GET /compute/v2.1/servers/6d72a6ee-e4bf-4eca-afd2-0047a95d57a5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:27:41.679972 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-26834d48-8462-42f4-8477-e9c21b99c531 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:41.680602 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-26834d48-8462-42f4-8477-e9c21b99c531 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:41.687162 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-26834d48-8462-42f4-8477-e9c21b99c531 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:41.687688 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-26834d48-8462-42f4-8477-e9c21b99c531 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:41.688129 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-26834d48-8462-42f4-8477-e9c21b99c531 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:41.688827 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-26834d48-8462-42f4-8477-e9c21b99c531 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:41.689287 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-26834d48-8462-42f4-8477-e9c21b99c531 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:41.689717 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-26834d48-8462-42f4-8477-e9c21b99c531 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:41.693886 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:41.717259 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-26834d48-8462-42f4-8477-e9c21b99c531 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Going to try to terminate instance {{(pid=120534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:27:41.799834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-26834d48-8462-42f4-8477-e9c21b99c531 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "DELETE /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 204 len: 0 microversion: 2.1 time: 0.125671 Sep 05 12:27:41.800449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 379/753] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:27:41 2022] DELETE /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 05 12:27:41.809501 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-37fda99e-568b-454f-a364-de5517e0e819 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:41.810108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-37fda99e-568b-454f-a364-de5517e0e819 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:41.816479 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-37fda99e-568b-454f-a364-de5517e0e819 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:41.816961 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-37fda99e-568b-454f-a364-de5517e0e819 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:41.817398 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-37fda99e-568b-454f-a364-de5517e0e819 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:41.818087 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-37fda99e-568b-454f-a364-de5517e0e819 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:41.818544 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-37fda99e-568b-454f-a364-de5517e0e819 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:41.818967 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-37fda99e-568b-454f-a364-de5517e0e819 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:41.958167 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-37fda99e-568b-454f-a364-de5517e0e819 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:41.966491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-37fda99e-568b-454f-a364-de5517e0e819 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.160841 Sep 05 12:27:41.967091 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 375/754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:41 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:42.657806 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b2d81ceb-4dc0-4b74-8291-b6eee1485999 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:42.658419 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b2d81ceb-4dc0-4b74-8291-b6eee1485999 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:42.660974 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:42.666323 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b2d81ceb-4dc0-4b74-8291-b6eee1485999 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:42.666813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b2d81ceb-4dc0-4b74-8291-b6eee1485999 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:42.667257 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b2d81ceb-4dc0-4b74-8291-b6eee1485999 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:42.667990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b2d81ceb-4dc0-4b74-8291-b6eee1485999 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:42.668454 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b2d81ceb-4dc0-4b74-8291-b6eee1485999 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:42.668884 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b2d81ceb-4dc0-4b74-8291-b6eee1485999 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:42.690109 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-3e15639d-232c-44a1-83e9-b2ceba6f5f1a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:42.690725 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3e15639d-232c-44a1-83e9-b2ceba6f5f1a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:42.697787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3e15639d-232c-44a1-83e9-b2ceba6f5f1a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:42.698279 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3e15639d-232c-44a1-83e9-b2ceba6f5f1a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:42.698717 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3e15639d-232c-44a1-83e9-b2ceba6f5f1a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:42.699415 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3e15639d-232c-44a1-83e9-b2ceba6f5f1a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:42.699901 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3e15639d-232c-44a1-83e9-b2ceba6f5f1a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:42.700332 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3e15639d-232c-44a1-83e9-b2ceba6f5f1a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:42.806045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b2d81ceb-4dc0-4b74-8291-b6eee1485999 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:42.813995 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b2d81ceb-4dc0-4b74-8291-b6eee1485999 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1361 microversion: 2.1 time: 0.160700 Sep 05 12:27:42.814566 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 380/755] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:42 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:42.838955 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-3e15639d-232c-44a1-83e9-b2ceba6f5f1a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:42.842430 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:42.847502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-3e15639d-232c-44a1-83e9-b2ceba6f5f1a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1576 microversion: 2.1 time: 0.161181 Sep 05 12:27:42.848095 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 376/756] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:42 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:42.990288 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f723346f-886c-4483-90d5-ce584adcc029 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:42.990813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f723346f-886c-4483-90d5-ce584adcc029 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:42.997859 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f723346f-886c-4483-90d5-ce584adcc029 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:42.998355 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f723346f-886c-4483-90d5-ce584adcc029 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:42.998791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f723346f-886c-4483-90d5-ce584adcc029 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:42.999576 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f723346f-886c-4483-90d5-ce584adcc029 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:43.000036 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f723346f-886c-4483-90d5-ce584adcc029 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:43.000462 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f723346f-886c-4483-90d5-ce584adcc029 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:43.133994 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f723346f-886c-4483-90d5-ce584adcc029 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:43.141651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f723346f-886c-4483-90d5-ce584adcc029 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.155407 Sep 05 12:27:43.142219 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 381/757] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:42 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:43.838906 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e9d03604-afa4-41ab-8aa4-c14207173d22 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:43.839800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e9d03604-afa4-41ab-8aa4-c14207173d22 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:43.847276 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9d03604-afa4-41ab-8aa4-c14207173d22 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:43.847969 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9d03604-afa4-41ab-8aa4-c14207173d22 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:43.848525 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9d03604-afa4-41ab-8aa4-c14207173d22 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:43.849248 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9d03604-afa4-41ab-8aa4-c14207173d22 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:43.849734 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9d03604-afa4-41ab-8aa4-c14207173d22 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:43.850164 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9d03604-afa4-41ab-8aa4-c14207173d22 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:43.870464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-cb986e79-1ad2-4098-90bf-b3d1102b9826 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:43.871122 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-cb986e79-1ad2-4098-90bf-b3d1102b9826 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:43.877892 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cb986e79-1ad2-4098-90bf-b3d1102b9826 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:43.878651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cb986e79-1ad2-4098-90bf-b3d1102b9826 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:43.879172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cb986e79-1ad2-4098-90bf-b3d1102b9826 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:43.879864 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cb986e79-1ad2-4098-90bf-b3d1102b9826 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:43.880330 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cb986e79-1ad2-4098-90bf-b3d1102b9826 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:43.880762 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cb986e79-1ad2-4098-90bf-b3d1102b9826 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:43.991026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e9d03604-afa4-41ab-8aa4-c14207173d22 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:43.999460 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e9d03604-afa4-41ab-8aa4-c14207173d22 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1361 microversion: 2.1 time: 0.165915 Sep 05 12:27:44.000351 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 377/758] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:43 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:44.164232 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6a3f6f93-792d-4e69-9b3c-3827b73254b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:44.164838 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6a3f6f93-792d-4e69-9b3c-3827b73254b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:44.171888 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6a3f6f93-792d-4e69-9b3c-3827b73254b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:44.172367 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6a3f6f93-792d-4e69-9b3c-3827b73254b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:44.172798 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6a3f6f93-792d-4e69-9b3c-3827b73254b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:44.173488 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6a3f6f93-792d-4e69-9b3c-3827b73254b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:44.173936 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6a3f6f93-792d-4e69-9b3c-3827b73254b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:44.174363 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6a3f6f93-792d-4e69-9b3c-3827b73254b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:44.193841 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-cb986e79-1ad2-4098-90bf-b3d1102b9826 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:44.202892 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-cb986e79-1ad2-4098-90bf-b3d1102b9826 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1576 microversion: 2.1 time: 0.336258 Sep 05 12:27:44.203929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 382/759] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:43 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1576 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:44.323241 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6a3f6f93-792d-4e69-9b3c-3827b73254b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:44.334802 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6a3f6f93-792d-4e69-9b3c-3827b73254b4 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1520 microversion: 2.1 time: 0.173980 Sep 05 12:27:44.339871 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 378/760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:44 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:44.780300 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-162b9f6a-2bc1-4143-ba1a-b81d76cb1e6c req-b0bbabb0-b72d-4f8f-8d0a-6c91f283571d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d0f215-d209-4143-924d-85e2b10edd9e", "name": "network-vif-deleted", "tag": "9674c5b2-c4af-437f-9c8d-565f5537d90b"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:27:44.790208 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-162b9f6a-2bc1-4143-ba1a-b81d76cb1e6c req-b0bbabb0-b72d-4f8f-8d0a-6c91f283571d service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:44.790683 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-162b9f6a-2bc1-4143-ba1a-b81d76cb1e6c req-b0bbabb0-b72d-4f8f-8d0a-6c91f283571d service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:44.791107 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-162b9f6a-2bc1-4143-ba1a-b81d76cb1e6c req-b0bbabb0-b72d-4f8f-8d0a-6c91f283571d service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:44.802096 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-162b9f6a-2bc1-4143-ba1a-b81d76cb1e6c req-b0bbabb0-b72d-4f8f-8d0a-6c91f283571d service nova] Creating event network-vif-deleted:9674c5b2-c4af-437f-9c8d-565f5537d90b for instance 98d0f215-d209-4143-924d-85e2b10edd9e on hv-cinder-85518 Sep 05 12:27:44.807458 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-162b9f6a-2bc1-4143-ba1a-b81d76cb1e6c req-b0bbabb0-b72d-4f8f-8d0a-6c91f283571d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031076 Sep 05 12:27:44.808082 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 383/761] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:45.022571 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d9de7456-c781-482e-98d3-70636a69d8f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:45.023630 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d9de7456-c781-482e-98d3-70636a69d8f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:45.029815 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d9de7456-c781-482e-98d3-70636a69d8f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:45.030300 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d9de7456-c781-482e-98d3-70636a69d8f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:45.030734 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d9de7456-c781-482e-98d3-70636a69d8f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:45.031421 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d9de7456-c781-482e-98d3-70636a69d8f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:45.031910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d9de7456-c781-482e-98d3-70636a69d8f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:45.032335 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d9de7456-c781-482e-98d3-70636a69d8f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:45.170248 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d9de7456-c781-482e-98d3-70636a69d8f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:45.178865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d9de7456-c781-482e-98d3-70636a69d8f0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1361 microversion: 2.1 time: 0.160053 Sep 05 12:27:45.188969 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 379/762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:45 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:45.228031 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-96df6e34-4b5b-4dfb-8e06-a4904680a6d0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:45.228739 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-96df6e34-4b5b-4dfb-8e06-a4904680a6d0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:45.234806 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-96df6e34-4b5b-4dfb-8e06-a4904680a6d0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:45.235281 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-96df6e34-4b5b-4dfb-8e06-a4904680a6d0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:45.235736 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-96df6e34-4b5b-4dfb-8e06-a4904680a6d0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:45.236422 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-96df6e34-4b5b-4dfb-8e06-a4904680a6d0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:45.236873 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-96df6e34-4b5b-4dfb-8e06-a4904680a6d0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:45.237292 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-96df6e34-4b5b-4dfb-8e06-a4904680a6d0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:45.357279 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-53feba64-eec5-4bf8-abe3-ff2755d8239b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:45.357897 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-53feba64-eec5-4bf8-abe3-ff2755d8239b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:45.364593 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-53feba64-eec5-4bf8-abe3-ff2755d8239b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:45.365203 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-53feba64-eec5-4bf8-abe3-ff2755d8239b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:45.365814 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-53feba64-eec5-4bf8-abe3-ff2755d8239b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:45.366522 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-53feba64-eec5-4bf8-abe3-ff2755d8239b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:45.366980 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-53feba64-eec5-4bf8-abe3-ff2755d8239b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:45.367408 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-53feba64-eec5-4bf8-abe3-ff2755d8239b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:45.371157 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-96df6e34-4b5b-4dfb-8e06-a4904680a6d0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:45.379325 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-96df6e34-4b5b-4dfb-8e06-a4904680a6d0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1576 microversion: 2.1 time: 0.156532 Sep 05 12:27:45.379935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 384/763] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:45 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:45.429852 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-53feba64-eec5-4bf8-abe3-ff2755d8239b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:45.437822 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-53feba64-eec5-4bf8-abe3-ff2755d8239b tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1478 microversion: 2.1 time: 0.084362 Sep 05 12:27:45.438393 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 380/764] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:45 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1478 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:45.782058 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-63cbebe8-59ee-4388-9a40-f771cdba6a15 req-9ba64f6b-771b-4fe0-add4-9d4912b8a2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4181d872-fbd4-4b16-b8c2-d086dd1253b2", "name": "network-vif-plugged", "status": "completed", "tag": "935d1954-274e-487a-b68a-696df548ac2a"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:27:45.793405 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-63cbebe8-59ee-4388-9a40-f771cdba6a15 req-9ba64f6b-771b-4fe0-add4-9d4912b8a2d7 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:45.793890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-63cbebe8-59ee-4388-9a40-f771cdba6a15 req-9ba64f6b-771b-4fe0-add4-9d4912b8a2d7 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:45.794664 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-63cbebe8-59ee-4388-9a40-f771cdba6a15 req-9ba64f6b-771b-4fe0-add4-9d4912b8a2d7 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:45.806395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-63cbebe8-59ee-4388-9a40-f771cdba6a15 req-9ba64f6b-771b-4fe0-add4-9d4912b8a2d7 service nova] Creating event network-vif-plugged:935d1954-274e-487a-b68a-696df548ac2a for instance 4181d872-fbd4-4b16-b8c2-d086dd1253b2 on hv-cinder-85518 Sep 05 12:27:45.811608 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-63cbebe8-59ee-4388-9a40-f771cdba6a15 req-9ba64f6b-771b-4fe0-add4-9d4912b8a2d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033603 Sep 05 12:27:45.812200 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 385/765] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:46.203224 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-eda5bbc6-433d-4555-8d7d-a87386fdcd01 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:46.203624 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-eda5bbc6-433d-4555-8d7d-a87386fdcd01 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:46.210255 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eda5bbc6-433d-4555-8d7d-a87386fdcd01 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:46.210776 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eda5bbc6-433d-4555-8d7d-a87386fdcd01 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:46.211203 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eda5bbc6-433d-4555-8d7d-a87386fdcd01 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:46.211916 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eda5bbc6-433d-4555-8d7d-a87386fdcd01 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:46.212361 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eda5bbc6-433d-4555-8d7d-a87386fdcd01 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:46.212780 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eda5bbc6-433d-4555-8d7d-a87386fdcd01 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:46.347165 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-eda5bbc6-433d-4555-8d7d-a87386fdcd01 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:46.355398 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-eda5bbc6-433d-4555-8d7d-a87386fdcd01 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1361 microversion: 2.1 time: 0.157131 Sep 05 12:27:46.355990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 381/766] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:46 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:46.403672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d6c2cbf0-dd90-4d9c-a603-1fe048d58c3f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:46.404402 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d6c2cbf0-dd90-4d9c-a603-1fe048d58c3f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:46.411054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d6c2cbf0-dd90-4d9c-a603-1fe048d58c3f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:46.411562 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d6c2cbf0-dd90-4d9c-a603-1fe048d58c3f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:46.412004 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d6c2cbf0-dd90-4d9c-a603-1fe048d58c3f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:46.412693 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d6c2cbf0-dd90-4d9c-a603-1fe048d58c3f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:46.413148 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d6c2cbf0-dd90-4d9c-a603-1fe048d58c3f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:46.414218 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d6c2cbf0-dd90-4d9c-a603-1fe048d58c3f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:46.461591 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-63bf5b1e-ae0a-4625-a413-9b831e1f5c27 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:46.462163 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-63bf5b1e-ae0a-4625-a413-9b831e1f5c27 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:46.468523 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-63bf5b1e-ae0a-4625-a413-9b831e1f5c27 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:46.469002 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-63bf5b1e-ae0a-4625-a413-9b831e1f5c27 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:46.469431 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-63bf5b1e-ae0a-4625-a413-9b831e1f5c27 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:46.470112 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-63bf5b1e-ae0a-4625-a413-9b831e1f5c27 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:46.470557 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-63bf5b1e-ae0a-4625-a413-9b831e1f5c27 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:46.470976 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-63bf5b1e-ae0a-4625-a413-9b831e1f5c27 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:46.536862 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-63bf5b1e-ae0a-4625-a413-9b831e1f5c27 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:46.545023 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-63bf5b1e-ae0a-4625-a413-9b831e1f5c27 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1478 microversion: 2.1 time: 0.087934 Sep 05 12:27:46.545587 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 382/767] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:46 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1478 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:46.548974 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d6c2cbf0-dd90-4d9c-a603-1fe048d58c3f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:46.557011 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d6c2cbf0-dd90-4d9c-a603-1fe048d58c3f tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1576 microversion: 2.1 time: 0.157820 Sep 05 12:27:46.557568 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 386/768] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:46 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:47.378836 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a8a39ae5-6b29-4025-ae8f-2342ab1afb81 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:47.379433 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a8a39ae5-6b29-4025-ae8f-2342ab1afb81 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:47.386351 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a8a39ae5-6b29-4025-ae8f-2342ab1afb81 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:47.386821 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a8a39ae5-6b29-4025-ae8f-2342ab1afb81 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:47.387247 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a8a39ae5-6b29-4025-ae8f-2342ab1afb81 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:47.387964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a8a39ae5-6b29-4025-ae8f-2342ab1afb81 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:47.388418 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a8a39ae5-6b29-4025-ae8f-2342ab1afb81 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:47.388832 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a8a39ae5-6b29-4025-ae8f-2342ab1afb81 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:47.522907 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a8a39ae5-6b29-4025-ae8f-2342ab1afb81 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:47.531700 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a8a39ae5-6b29-4025-ae8f-2342ab1afb81 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1361 microversion: 2.1 time: 0.156673 Sep 05 12:27:47.532290 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 383/769] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:47 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:47.568065 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-61ce7541-d5f8-4d2b-a5ab-ec935b63177a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:47.568681 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-61ce7541-d5f8-4d2b-a5ab-ec935b63177a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:47.581226 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61ce7541-d5f8-4d2b-a5ab-ec935b63177a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:47.581751 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61ce7541-d5f8-4d2b-a5ab-ec935b63177a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:47.582170 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61ce7541-d5f8-4d2b-a5ab-ec935b63177a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:47.582879 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61ce7541-d5f8-4d2b-a5ab-ec935b63177a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:47.583340 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61ce7541-d5f8-4d2b-a5ab-ec935b63177a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:47.583788 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61ce7541-d5f8-4d2b-a5ab-ec935b63177a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:47.588126 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e31d4cf2-4f0f-4c43-90ba-637835e87e46 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:47.589050 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e31d4cf2-4f0f-4c43-90ba-637835e87e46 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:47.596373 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e31d4cf2-4f0f-4c43-90ba-637835e87e46 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:47.596872 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e31d4cf2-4f0f-4c43-90ba-637835e87e46 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:47.597863 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e31d4cf2-4f0f-4c43-90ba-637835e87e46 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:47.598589 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e31d4cf2-4f0f-4c43-90ba-637835e87e46 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:47.599067 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e31d4cf2-4f0f-4c43-90ba-637835e87e46 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:47.599468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e31d4cf2-4f0f-4c43-90ba-637835e87e46 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:47.624553 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61ce7541-d5f8-4d2b-a5ab-ec935b63177a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:47.625043 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61ce7541-d5f8-4d2b-a5ab-ec935b63177a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:47.625480 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61ce7541-d5f8-4d2b-a5ab-ec935b63177a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:47.625923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.objects.instance [None req-61ce7541-d5f8-4d2b-a5ab-ec935b63177a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lazy-loading 'fault' on Instance uuid 98d0f215-d209-4143-924d-85e2b10edd9e {{(pid=120534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:27:47.667231 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-61ce7541-d5f8-4d2b-a5ab-ec935b63177a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:47.674694 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-61ce7541-d5f8-4d2b-a5ab-ec935b63177a tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1311 microversion: 2.1 time: 0.110625 Sep 05 12:27:47.675266 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 387/770] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:47 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:47.737729 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e31d4cf2-4f0f-4c43-90ba-637835e87e46 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:47.746130 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e31d4cf2-4f0f-4c43-90ba-637835e87e46 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1576 microversion: 2.1 time: 0.169743 Sep 05 12:27:47.746706 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 384/771] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:47 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:48.556715 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4658b76c-bbc8-4902-96e6-4c85ed7ac39a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:48.557341 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4658b76c-bbc8-4902-96e6-4c85ed7ac39a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:48.559459 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:48.564787 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4658b76c-bbc8-4902-96e6-4c85ed7ac39a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:48.565267 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4658b76c-bbc8-4902-96e6-4c85ed7ac39a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:48.565721 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4658b76c-bbc8-4902-96e6-4c85ed7ac39a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:48.566397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4658b76c-bbc8-4902-96e6-4c85ed7ac39a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:48.566850 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4658b76c-bbc8-4902-96e6-4c85ed7ac39a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:48.567346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4658b76c-bbc8-4902-96e6-4c85ed7ac39a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:48.700260 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-03b202d7-2779-4b6c-b5cc-d9c142ae9a0c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:48.700782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4658b76c-bbc8-4902-96e6-4c85ed7ac39a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:48.701158 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-03b202d7-2779-4b6c-b5cc-d9c142ae9a0c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:48.702712 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:48.703629 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=10 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:48.708223 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4658b76c-bbc8-4902-96e6-4c85ed7ac39a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1361 microversion: 2.1 time: 0.155946 Sep 05 12:27:48.708876 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 388/772] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:48 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:48.710907 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-03b202d7-2779-4b6c-b5cc-d9c142ae9a0c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:48.711400 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-03b202d7-2779-4b6c-b5cc-d9c142ae9a0c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:48.711861 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-03b202d7-2779-4b6c-b5cc-d9c142ae9a0c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:48.712565 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-03b202d7-2779-4b6c-b5cc-d9c142ae9a0c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:48.713024 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-03b202d7-2779-4b6c-b5cc-d9c142ae9a0c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:48.713455 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-03b202d7-2779-4b6c-b5cc-d9c142ae9a0c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:48.744819 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-03b202d7-2779-4b6c-b5cc-d9c142ae9a0c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:48.745299 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-03b202d7-2779-4b6c-b5cc-d9c142ae9a0c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:48.745736 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-03b202d7-2779-4b6c-b5cc-d9c142ae9a0c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:48.746184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-03b202d7-2779-4b6c-b5cc-d9c142ae9a0c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lazy-loading 'fault' on Instance uuid 98d0f215-d209-4143-924d-85e2b10edd9e {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:27:48.768673 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-37377f0d-4083-4e7e-9710-d62b3edc2750 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:48.769833 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-37377f0d-4083-4e7e-9710-d62b3edc2750 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:48.775982 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37377f0d-4083-4e7e-9710-d62b3edc2750 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:48.776484 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37377f0d-4083-4e7e-9710-d62b3edc2750 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:48.776949 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37377f0d-4083-4e7e-9710-d62b3edc2750 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:48.777661 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37377f0d-4083-4e7e-9710-d62b3edc2750 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:48.778387 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37377f0d-4083-4e7e-9710-d62b3edc2750 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:48.778805 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37377f0d-4083-4e7e-9710-d62b3edc2750 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:48.791079 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-03b202d7-2779-4b6c-b5cc-d9c142ae9a0c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0999bd21bf4db5981053922200be2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938f765828c545a8840a6983bc5d9e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:48.798957 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-03b202d7-2779-4b6c-b5cc-d9c142ae9a0c tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 200 len: 1311 microversion: 2.1 time: 0.102602 Sep 05 12:27:48.800097 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 385/773] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:48 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:48.914003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-37377f0d-4083-4e7e-9710-d62b3edc2750 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:48.922903 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-37377f0d-4083-4e7e-9710-d62b3edc2750 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1576 microversion: 2.1 time: 0.158181 Sep 05 12:27:48.923471 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 389/774] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:48 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:49.732599 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ccb6d5a2-6f27-4c0e-a06e-3e14fc72a566 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:49.733999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ccb6d5a2-6f27-4c0e-a06e-3e14fc72a566 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:49.741128 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ccb6d5a2-6f27-4c0e-a06e-3e14fc72a566 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:49.741620 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ccb6d5a2-6f27-4c0e-a06e-3e14fc72a566 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:49.742064 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ccb6d5a2-6f27-4c0e-a06e-3e14fc72a566 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:49.742758 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ccb6d5a2-6f27-4c0e-a06e-3e14fc72a566 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:49.743214 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ccb6d5a2-6f27-4c0e-a06e-3e14fc72a566 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:49.743666 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ccb6d5a2-6f27-4c0e-a06e-3e14fc72a566 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:49.823098 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-018f49c3-79b3-42d2-84d4-8569b082a8b6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:49.823901 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-018f49c3-79b3-42d2-84d4-8569b082a8b6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] [instance: 98d0f215-d209-4143-924d-85e2b10edd9e] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:49.830354 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-018f49c3-79b3-42d2-84d4-8569b082a8b6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:49.830833 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-018f49c3-79b3-42d2-84d4-8569b082a8b6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:49.831262 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-018f49c3-79b3-42d2-84d4-8569b082a8b6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:49.831990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-018f49c3-79b3-42d2-84d4-8569b082a8b6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:49.832701 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-018f49c3-79b3-42d2-84d4-8569b082a8b6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:49.833127 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-018f49c3-79b3-42d2-84d4-8569b082a8b6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:49.848474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-018f49c3-79b3-42d2-84d4-8569b082a8b6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] HTTP exception thrown: Instance 98d0f215-d209-4143-924d-85e2b10edd9e could not be found. Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-018f49c3-79b3-42d2-84d4-8569b082a8b6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Request method failure captured: Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e HTTP/1.1 Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFemrRjsZ90kVZGEYqus02Ie2QEuWipxU6VktRw18WSg3Fpgy9K9kJquxI27KqHdB07zJsep0zf_MlmvFbu20x7ARqbxgkdDrmFUuOBlSs7bfiiMuDgXotQH7Nd3_qhrMVZfo6sO74REUpDPYIGAv4U70gu44RmLra0MEy0GinSKViEY Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 938f765828c545a8840a6983bc5d9e6d Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:27:49.851344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:27:49.853126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_938f765828c545a8840a6983bc5d9e6d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/938f765828c545a8840a6983bc5d9e6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/938f765828c545a8840a6983bc5d9e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/938f765828c545a8840a6983bc5d9e6d"}]}] Sep 05 12:27:49.853126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:27:49.853126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 938f765828c545a8840a6983bc5d9e6d Sep 05 12:27:49.853126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-798904028 Sep 05 12:27:49.853126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-ServerRescueNegativeTestJSON-798904028-project Sep 05 12:27:49.853126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:27:49.853126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:27:49.853126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: ff0999bd21bf4db5981053922200be2a Sep 05 12:27:49.853126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-ServerRescueNegativeTestJSON-798904028-project Sep 05 12:27:49.853126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:27:49.853126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 98d0f215-d209-4143-924d-85e2b10edd9e could not be found. Sep 05 12:27:49.853126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '98d0f215-d209-4143-924d-85e2b10edd9e'} Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d0f215-d209-4143-924d-85e2b10edd9e could not be found. Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:27:49.854054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d0f215-d209-4143-924d-85e2b10edd9e could not be found. Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d0f215-d209-4143-924d-85e2b10edd9e could not be found. Sep 05 12:27:49.855680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:27:49.857090 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-018f49c3-79b3-42d2-84d4-8569b082a8b6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] Returning 404 to user: Instance 98d0f215-d209-4143-924d-85e2b10edd9e could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:27:49.857090 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-018f49c3-79b3-42d2-84d4-8569b082a8b6 tempest-ServerRescueNegativeTestJSON-798904028 tempest-ServerRescueNegativeTestJSON-798904028-project] 10.222.0.16 "GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e" status: 404 len: 111 microversion: 2.1 time: 0.034477 Sep 05 12:27:49.857090 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 390/775] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:49 2022] GET /compute/v2.1/servers/98d0f215-d209-4143-924d-85e2b10edd9e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 12:27:49.891058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ccb6d5a2-6f27-4c0e-a06e-3e14fc72a566 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:49.899462 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ccb6d5a2-6f27-4c0e-a06e-3e14fc72a566 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1361 microversion: 2.1 time: 0.170652 Sep 05 12:27:49.900141 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 386/776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:49 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:49.947637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-881f1216-4ed9-4fae-94c3-61ddcc0b577e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:49.948159 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-881f1216-4ed9-4fae-94c3-61ddcc0b577e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:49.954023 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-881f1216-4ed9-4fae-94c3-61ddcc0b577e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:49.954501 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-881f1216-4ed9-4fae-94c3-61ddcc0b577e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:49.954938 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-881f1216-4ed9-4fae-94c3-61ddcc0b577e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:49.955646 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-881f1216-4ed9-4fae-94c3-61ddcc0b577e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:49.956098 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-881f1216-4ed9-4fae-94c3-61ddcc0b577e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:49.956520 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-881f1216-4ed9-4fae-94c3-61ddcc0b577e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:50.203475 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-881f1216-4ed9-4fae-94c3-61ddcc0b577e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:50.211977 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-881f1216-4ed9-4fae-94c3-61ddcc0b577e tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1563 microversion: 2.1 time: 0.268690 Sep 05 12:27:50.212800 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 391/777] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:49 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1563 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:50.922433 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ff0dbf95-517e-4eb1-a94c-f2e6f7725dad tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:50.923056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ff0dbf95-517e-4eb1-a94c-f2e6f7725dad tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:50.930589 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ff0dbf95-517e-4eb1-a94c-f2e6f7725dad tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:50.931078 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ff0dbf95-517e-4eb1-a94c-f2e6f7725dad tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:50.931516 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ff0dbf95-517e-4eb1-a94c-f2e6f7725dad tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:50.932311 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ff0dbf95-517e-4eb1-a94c-f2e6f7725dad tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:50.932763 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ff0dbf95-517e-4eb1-a94c-f2e6f7725dad tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:50.933234 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ff0dbf95-517e-4eb1-a94c-f2e6f7725dad tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:51.091283 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ff0dbf95-517e-4eb1-a94c-f2e6f7725dad tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:51.099693 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ff0dbf95-517e-4eb1-a94c-f2e6f7725dad tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1361 microversion: 2.1 time: 0.181042 Sep 05 12:27:51.102284 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 387/778] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:50 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:51.761717 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-6907b58f-33b3-4623-8da4-688f3c7af97b req-7a2981b2-8a27-41d1-82c9-2c7c4e9a3b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "887dcf0e-194f-41f2-bfa6-5e8e41fc24f6", "name": "network-vif-plugged", "status": "completed", "tag": "fb563ae1-134e-4704-a744-d3c52eb2c338"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:27:51.777781 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6907b58f-33b3-4623-8da4-688f3c7af97b req-7a2981b2-8a27-41d1-82c9-2c7c4e9a3b28 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:51.778859 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6907b58f-33b3-4623-8da4-688f3c7af97b req-7a2981b2-8a27-41d1-82c9-2c7c4e9a3b28 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:51.779648 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6907b58f-33b3-4623-8da4-688f3c7af97b req-7a2981b2-8a27-41d1-82c9-2c7c4e9a3b28 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:51.792526 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-6907b58f-33b3-4623-8da4-688f3c7af97b req-7a2981b2-8a27-41d1-82c9-2c7c4e9a3b28 service nova] Creating event network-vif-plugged:fb563ae1-134e-4704-a744-d3c52eb2c338 for instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 on hv-cinder-85518 Sep 05 12:27:51.799016 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-6907b58f-33b3-4623-8da4-688f3c7af97b req-7a2981b2-8a27-41d1-82c9-2c7c4e9a3b28 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043364 Sep 05 12:27:51.800439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 392/779] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:52.124227 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8c503073-03b7-4852-8172-58f52381c61a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:52.124838 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8c503073-03b7-4852-8172-58f52381c61a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:52.131813 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8c503073-03b7-4852-8172-58f52381c61a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:52.132300 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8c503073-03b7-4852-8172-58f52381c61a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:52.132741 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8c503073-03b7-4852-8172-58f52381c61a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:52.133430 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8c503073-03b7-4852-8172-58f52381c61a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:52.133883 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8c503073-03b7-4852-8172-58f52381c61a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:52.134337 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8c503073-03b7-4852-8172-58f52381c61a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:52.283817 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8c503073-03b7-4852-8172-58f52381c61a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:52.297415 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8c503073-03b7-4852-8172-58f52381c61a tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1361 microversion: 2.1 time: 0.176469 Sep 05 12:27:52.298652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 388/780] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:52 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:27:53.324880 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-16b53d90-f956-4cde-a749-03aafddb0aec tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:53.325664 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-16b53d90-f956-4cde-a749-03aafddb0aec tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:53.337402 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16b53d90-f956-4cde-a749-03aafddb0aec tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:53.338100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16b53d90-f956-4cde-a749-03aafddb0aec tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:53.338717 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16b53d90-f956-4cde-a749-03aafddb0aec tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:53.339736 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16b53d90-f956-4cde-a749-03aafddb0aec tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:53.340976 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16b53d90-f956-4cde-a749-03aafddb0aec tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:53.341735 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16b53d90-f956-4cde-a749-03aafddb0aec tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:53.527411 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-16b53d90-f956-4cde-a749-03aafddb0aec tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:53.535540 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-16b53d90-f956-4cde-a749-03aafddb0aec tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1361 microversion: 2.1 time: 0.217109 Sep 05 12:27:53.536120 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 393/781] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:53 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:54.558465 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6bf689b7-2bf2-4135-a256-8f134703c006 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:54.559205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6bf689b7-2bf2-4135-a256-8f134703c006 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:54.565381 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6bf689b7-2bf2-4135-a256-8f134703c006 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:54.565855 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6bf689b7-2bf2-4135-a256-8f134703c006 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:54.566288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6bf689b7-2bf2-4135-a256-8f134703c006 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:54.566968 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6bf689b7-2bf2-4135-a256-8f134703c006 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:54.567417 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6bf689b7-2bf2-4135-a256-8f134703c006 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:54.567913 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6bf689b7-2bf2-4135-a256-8f134703c006 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:54.711302 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6bf689b7-2bf2-4135-a256-8f134703c006 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:27:54.721070 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6bf689b7-2bf2-4135-a256-8f134703c006 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1547 microversion: 2.1 time: 0.166880 Sep 05 12:27:54.721649 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 389/782] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:27:54 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:54.746634 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7ceb5d1e-7ef3-48fa-ab40-e7c32f5cb381 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:54.747653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7ceb5d1e-7ef3-48fa-ab40-e7c32f5cb381 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:27:54.754515 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ceb5d1e-7ef3-48fa-ab40-e7c32f5cb381 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:54.755008 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ceb5d1e-7ef3-48fa-ab40-e7c32f5cb381 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:54.755454 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ceb5d1e-7ef3-48fa-ab40-e7c32f5cb381 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:54.756230 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ceb5d1e-7ef3-48fa-ab40-e7c32f5cb381 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:54.756864 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ceb5d1e-7ef3-48fa-ab40-e7c32f5cb381 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:54.757970 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7ceb5d1e-7ef3-48fa-ab40-e7c32f5cb381 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:54.838913 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7ceb5d1e-7ef3-48fa-ab40-e7c32f5cb381 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096288 Sep 05 12:27:54.839571 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 394/783] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Sep 5 12:27:54 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:56.078882 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-bac4d078-c5f6-4ae5-94cc-8d3be5e21e9e req-0bd0735e-c371-418d-ace9-23206263d989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "887dcf0e-194f-41f2-bfa6-5e8e41fc24f6", "tag": "fb563ae1-134e-4704-a744-d3c52eb2c338"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:27:56.089682 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-bac4d078-c5f6-4ae5-94cc-8d3be5e21e9e req-0bd0735e-c371-418d-ace9-23206263d989 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:56.090165 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-bac4d078-c5f6-4ae5-94cc-8d3be5e21e9e req-0bd0735e-c371-418d-ace9-23206263d989 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:56.090605 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-bac4d078-c5f6-4ae5-94cc-8d3be5e21e9e req-0bd0735e-c371-418d-ace9-23206263d989 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:56.101915 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-bac4d078-c5f6-4ae5-94cc-8d3be5e21e9e req-0bd0735e-c371-418d-ace9-23206263d989 service nova] Creating event network-changed:fb563ae1-134e-4704-a744-d3c52eb2c338 for instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 on hv-cinder-85518 Sep 05 12:27:56.106929 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-bac4d078-c5f6-4ae5-94cc-8d3be5e21e9e req-0bd0735e-c371-418d-ace9-23206263d989 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031948 Sep 05 12:27:56.107640 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 390/784] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:28:27.436999 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=31 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:28:27.437745 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:28:27.442049 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-06daf682-8a3e-4933-9500-bd1fa745c126 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:27.442538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-06daf682-8a3e-4933-9500-bd1fa745c126 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:27.450068 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-06daf682-8a3e-4933-9500-bd1fa745c126 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:27.451079 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-06daf682-8a3e-4933-9500-bd1fa745c126 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:27.451511 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-06daf682-8a3e-4933-9500-bd1fa745c126 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:27.452218 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-06daf682-8a3e-4933-9500-bd1fa745c126 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:27.452665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-06daf682-8a3e-4933-9500-bd1fa745c126 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:27.453088 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-06daf682-8a3e-4933-9500-bd1fa745c126 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:27.477406 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-06daf682-8a3e-4933-9500-bd1fa745c126 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804/ips" status: 200 len: 151 microversion: 2.20 time: 0.042063 Sep 05 12:28:27.477973 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 395/785] 10.222.0.16 () {60 vars in 1289 bytes} [Mon Sep 5 12:28:27 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:28:29.289881 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=38 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:28:29.290643 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=82 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:28:29.295214 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ae37ea1f-5c46-4f64-b321-fa2595b89129 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:28:29.295869 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ae37ea1f-5c46-4f64-b321-fa2595b89129 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:29.302789 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ae37ea1f-5c46-4f64-b321-fa2595b89129 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:29.303287 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ae37ea1f-5c46-4f64-b321-fa2595b89129 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:29.303726 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ae37ea1f-5c46-4f64-b321-fa2595b89129 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:29.304453 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ae37ea1f-5c46-4f64-b321-fa2595b89129 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:29.304873 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ae37ea1f-5c46-4f64-b321-fa2595b89129 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:29.305259 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ae37ea1f-5c46-4f64-b321-fa2595b89129 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:29.333487 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-ae37ea1f-5c46-4f64-b321-fa2595b89129 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lazy-loading 'flavor' on Instance uuid 0055a73c-7732-48a3-b76b-3b8cc28e7804 {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:28:29.528987 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ae37ea1f-5c46-4f64-b321-fa2595b89129 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "POST /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804/action" status: 202 len: 0 microversion: 2.20 time: 0.239643 Sep 05 12:28:29.529492 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 391/786] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Sep 5 12:28:29 2022] POST /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:28:29.538941 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5b587178-06e7-4712-8063-9da5e7bf3039 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:29.539602 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5b587178-06e7-4712-8063-9da5e7bf3039 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:29.547885 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5b587178-06e7-4712-8063-9da5e7bf3039 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:29.548378 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5b587178-06e7-4712-8063-9da5e7bf3039 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:29.549022 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5b587178-06e7-4712-8063-9da5e7bf3039 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:29.550771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5b587178-06e7-4712-8063-9da5e7bf3039 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:29.551644 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5b587178-06e7-4712-8063-9da5e7bf3039 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:29.552078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5b587178-06e7-4712-8063-9da5e7bf3039 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:29.696884 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5b587178-06e7-4712-8063-9da5e7bf3039 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:29.705250 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5b587178-06e7-4712-8063-9da5e7bf3039 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:29.706777 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5b587178-06e7-4712-8063-9da5e7bf3039 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:29.708066 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5b587178-06e7-4712-8063-9da5e7bf3039 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1723 microversion: 2.20 time: 0.173348 Sep 05 12:28:29.708628 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 396/787] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:29 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:28:30.737838 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-fe04c743-404d-40f8-ab70-83e449253e85 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:30.739133 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-fe04c743-404d-40f8-ab70-83e449253e85 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:30.745736 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fe04c743-404d-40f8-ab70-83e449253e85 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:30.746228 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fe04c743-404d-40f8-ab70-83e449253e85 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:30.746693 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fe04c743-404d-40f8-ab70-83e449253e85 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:30.747937 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fe04c743-404d-40f8-ab70-83e449253e85 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:30.748391 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fe04c743-404d-40f8-ab70-83e449253e85 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:30.748816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-fe04c743-404d-40f8-ab70-83e449253e85 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:30.880899 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-fe04c743-404d-40f8-ab70-83e449253e85 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:30.889101 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-fe04c743-404d-40f8-ab70-83e449253e85 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:30.890548 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-fe04c743-404d-40f8-ab70-83e449253e85 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:30.891905 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-fe04c743-404d-40f8-ab70-83e449253e85 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1723 microversion: 2.20 time: 0.160965 Sep 05 12:28:30.892464 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 392/788] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:30 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:31.917942 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ac93c6dc-0b11-4d07-bb09-4ae5b40a108f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:31.918542 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ac93c6dc-0b11-4d07-bb09-4ae5b40a108f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:31.925396 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ac93c6dc-0b11-4d07-bb09-4ae5b40a108f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:31.925878 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ac93c6dc-0b11-4d07-bb09-4ae5b40a108f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:31.926315 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ac93c6dc-0b11-4d07-bb09-4ae5b40a108f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:31.927010 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ac93c6dc-0b11-4d07-bb09-4ae5b40a108f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:31.927469 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ac93c6dc-0b11-4d07-bb09-4ae5b40a108f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:31.927923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ac93c6dc-0b11-4d07-bb09-4ae5b40a108f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:32.056259 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ac93c6dc-0b11-4d07-bb09-4ae5b40a108f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:32.064999 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ac93c6dc-0b11-4d07-bb09-4ae5b40a108f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:32.066433 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ac93c6dc-0b11-4d07-bb09-4ae5b40a108f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:32.067651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ac93c6dc-0b11-4d07-bb09-4ae5b40a108f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1723 microversion: 2.20 time: 0.153620 Sep 05 12:28:32.068202 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 397/789] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:31 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:32.175331 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1177321762", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "networks": [{"uuid": "0358ea68-d230-42b8-ae52-c227d3ce766b"}]}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:28:32.230290 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.network.neutron [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] validate_networks() for [('0358ea68-d230-42b8-ae52-c227d3ce766b', None, None, None, None, None)] {{(pid=120535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:28:32.582932 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Flavor limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:28:32.583378 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Image limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:28:32.583912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Flavor pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:28:32.584322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Image pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:28:32.584734 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:28:32.593386 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:32.593881 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:32.594301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:32.595024 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:32.595479 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:32.595949 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:32.612782 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Getting quotas for project 1645a9dd82b14c25892cec9be947f310. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:28:32.616672 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Getting quotas for user 51ad1f400be2465dbfb4a14698247496 and project 1645a9dd82b14c25892cec9be947f310. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:28:32.628030 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Going to run 1 instances... {{(pid=120535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:28:32.630310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:28:32.676808 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9a16b843-fd6d-4a01-b4ad-2c6951be291d tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505371 Sep 05 12:28:32.677455 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 393/790] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:28:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:28:32.689201 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b134ade2-8dd8-44de-9a1a-d64852af66cf tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:32.689822 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b134ade2-8dd8-44de-9a1a-d64852af66cf tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:32.742610 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b134ade2-8dd8-44de-9a1a-d64852af66cf tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:32.749796 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b134ade2-8dd8-44de-9a1a-d64852af66cf tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1214 microversion: 2.1 time: 0.065165 Sep 05 12:28:32.750369 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 398/791] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:32 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:33.094861 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-379ccf02-afe5-4e4c-a77e-c9be57786ccf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:33.095462 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-379ccf02-afe5-4e4c-a77e-c9be57786ccf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:33.101763 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-379ccf02-afe5-4e4c-a77e-c9be57786ccf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:33.102247 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-379ccf02-afe5-4e4c-a77e-c9be57786ccf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:33.102684 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-379ccf02-afe5-4e4c-a77e-c9be57786ccf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:33.104091 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-379ccf02-afe5-4e4c-a77e-c9be57786ccf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:33.105414 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-379ccf02-afe5-4e4c-a77e-c9be57786ccf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:33.106117 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-379ccf02-afe5-4e4c-a77e-c9be57786ccf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:33.247216 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-379ccf02-afe5-4e4c-a77e-c9be57786ccf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:33.255458 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-379ccf02-afe5-4e4c-a77e-c9be57786ccf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:33.256889 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-379ccf02-afe5-4e4c-a77e-c9be57786ccf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:33.258123 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-379ccf02-afe5-4e4c-a77e-c9be57786ccf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1723 microversion: 2.20 time: 0.167723 Sep 05 12:28:33.259329 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 394/792] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:33 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:33.776811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-52cc88df-96a6-4e1c-88d7-61306aed5b34 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:33.777442 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-52cc88df-96a6-4e1c-88d7-61306aed5b34 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:33.784790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52cc88df-96a6-4e1c-88d7-61306aed5b34 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:33.785276 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52cc88df-96a6-4e1c-88d7-61306aed5b34 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:33.785713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52cc88df-96a6-4e1c-88d7-61306aed5b34 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:33.786407 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52cc88df-96a6-4e1c-88d7-61306aed5b34 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:33.786871 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52cc88df-96a6-4e1c-88d7-61306aed5b34 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:33.787302 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-52cc88df-96a6-4e1c-88d7-61306aed5b34 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:33.854485 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-52cc88df-96a6-4e1c-88d7-61306aed5b34 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:33.863027 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-52cc88df-96a6-4e1c-88d7-61306aed5b34 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1266 microversion: 2.1 time: 0.090226 Sep 05 12:28:33.863617 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 399/793] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:33 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:34.284707 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f3bb5d39-0e5c-4696-98d5-46552adce47d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:34.285326 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f3bb5d39-0e5c-4696-98d5-46552adce47d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:34.291606 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f3bb5d39-0e5c-4696-98d5-46552adce47d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:34.292099 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f3bb5d39-0e5c-4696-98d5-46552adce47d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:34.292539 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f3bb5d39-0e5c-4696-98d5-46552adce47d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:34.293243 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f3bb5d39-0e5c-4696-98d5-46552adce47d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:34.293702 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f3bb5d39-0e5c-4696-98d5-46552adce47d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:34.294130 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f3bb5d39-0e5c-4696-98d5-46552adce47d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:34.510096 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f3bb5d39-0e5c-4696-98d5-46552adce47d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:34.518233 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f3bb5d39-0e5c-4696-98d5-46552adce47d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:34.519711 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f3bb5d39-0e5c-4696-98d5-46552adce47d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:34.520867 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f3bb5d39-0e5c-4696-98d5-46552adce47d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1723 microversion: 2.20 time: 0.240087 Sep 05 12:28:34.521438 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 395/794] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:34 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:28:34.886685 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1893060c-fa91-43a5-b49c-27dc16a8cd15 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:34.887305 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1893060c-fa91-43a5-b49c-27dc16a8cd15 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:34.894838 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1893060c-fa91-43a5-b49c-27dc16a8cd15 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:34.895332 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1893060c-fa91-43a5-b49c-27dc16a8cd15 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:34.895796 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1893060c-fa91-43a5-b49c-27dc16a8cd15 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:34.896529 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1893060c-fa91-43a5-b49c-27dc16a8cd15 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:34.897059 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1893060c-fa91-43a5-b49c-27dc16a8cd15 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:34.897489 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1893060c-fa91-43a5-b49c-27dc16a8cd15 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:35.027360 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1893060c-fa91-43a5-b49c-27dc16a8cd15 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:35.035532 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1893060c-fa91-43a5-b49c-27dc16a8cd15 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1314 microversion: 2.1 time: 0.152717 Sep 05 12:28:35.036119 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 400/795] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:34 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:35.420063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-ab9863b5-2079-49d4-9fde-2ec0d5a9ad36 req-5903bc18-d377-41c6-8825-345227ef6529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af96fecc-6ff9-4be8-8598-e1bc2b672be9", "tag": "0fa4eae4-323f-4d5f-8955-0b0e3843a896"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:28:35.431313 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-ab9863b5-2079-49d4-9fde-2ec0d5a9ad36 req-5903bc18-d377-41c6-8825-345227ef6529 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:35.431831 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-ab9863b5-2079-49d4-9fde-2ec0d5a9ad36 req-5903bc18-d377-41c6-8825-345227ef6529 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:35.432283 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-ab9863b5-2079-49d4-9fde-2ec0d5a9ad36 req-5903bc18-d377-41c6-8825-345227ef6529 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:35.443836 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-ab9863b5-2079-49d4-9fde-2ec0d5a9ad36 req-5903bc18-d377-41c6-8825-345227ef6529 service nova] Creating event network-changed:0fa4eae4-323f-4d5f-8955-0b0e3843a896 for instance af96fecc-6ff9-4be8-8598-e1bc2b672be9 on hv-cinder-85518 Sep 05 12:28:35.448632 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-ab9863b5-2079-49d4-9fde-2ec0d5a9ad36 req-5903bc18-d377-41c6-8825-345227ef6529 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033956 Sep 05 12:28:35.449392 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 396/796] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:28:35.549406 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f83336c5-91dc-4585-a35e-67a696fbfbc5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:35.550114 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f83336c5-91dc-4585-a35e-67a696fbfbc5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:35.556090 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f83336c5-91dc-4585-a35e-67a696fbfbc5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:35.556626 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f83336c5-91dc-4585-a35e-67a696fbfbc5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:35.557025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f83336c5-91dc-4585-a35e-67a696fbfbc5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:35.557732 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f83336c5-91dc-4585-a35e-67a696fbfbc5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:35.558192 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f83336c5-91dc-4585-a35e-67a696fbfbc5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:35.558622 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f83336c5-91dc-4585-a35e-67a696fbfbc5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:35.690531 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f83336c5-91dc-4585-a35e-67a696fbfbc5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:35.698998 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f83336c5-91dc-4585-a35e-67a696fbfbc5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:35.700498 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f83336c5-91dc-4585-a35e-67a696fbfbc5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:35.701662 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f83336c5-91dc-4585-a35e-67a696fbfbc5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1723 microversion: 2.20 time: 0.156204 Sep 05 12:28:35.702220 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 401/797] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:35 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:36.058663 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-801c0692-4f14-4f11-92c2-67e5e28f4937 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:36.059367 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-801c0692-4f14-4f11-92c2-67e5e28f4937 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:36.065593 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-801c0692-4f14-4f11-92c2-67e5e28f4937 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:36.066120 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-801c0692-4f14-4f11-92c2-67e5e28f4937 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:36.066517 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-801c0692-4f14-4f11-92c2-67e5e28f4937 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:36.067208 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-801c0692-4f14-4f11-92c2-67e5e28f4937 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:36.067707 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-801c0692-4f14-4f11-92c2-67e5e28f4937 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:36.068137 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-801c0692-4f14-4f11-92c2-67e5e28f4937 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:36.196056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-801c0692-4f14-4f11-92c2-67e5e28f4937 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:36.204556 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-801c0692-4f14-4f11-92c2-67e5e28f4937 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1314 microversion: 2.1 time: 0.149996 Sep 05 12:28:36.205574 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 397/798] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:36 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:36.727984 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-86b7869f-d781-4856-a4eb-0b5542138f71 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:36.728609 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-86b7869f-d781-4856-a4eb-0b5542138f71 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:36.734839 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-86b7869f-d781-4856-a4eb-0b5542138f71 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:36.735343 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-86b7869f-d781-4856-a4eb-0b5542138f71 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:36.735812 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-86b7869f-d781-4856-a4eb-0b5542138f71 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:36.736540 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-86b7869f-d781-4856-a4eb-0b5542138f71 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:36.736997 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-86b7869f-d781-4856-a4eb-0b5542138f71 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:36.737425 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-86b7869f-d781-4856-a4eb-0b5542138f71 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:36.868776 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-86b7869f-d781-4856-a4eb-0b5542138f71 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:36.877349 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-86b7869f-d781-4856-a4eb-0b5542138f71 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:36.878789 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-86b7869f-d781-4856-a4eb-0b5542138f71 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:36.879968 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-86b7869f-d781-4856-a4eb-0b5542138f71 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1723 microversion: 2.20 time: 0.156060 Sep 05 12:28:36.880523 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 402/799] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:36 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:37.227309 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1eac1a86-07a8-4d9c-8b7b-7f987f026407 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:37.227938 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-1eac1a86-07a8-4d9c-8b7b-7f987f026407 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:37.235303 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1eac1a86-07a8-4d9c-8b7b-7f987f026407 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:37.235807 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1eac1a86-07a8-4d9c-8b7b-7f987f026407 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:37.236237 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1eac1a86-07a8-4d9c-8b7b-7f987f026407 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:37.236912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1eac1a86-07a8-4d9c-8b7b-7f987f026407 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:37.237358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1eac1a86-07a8-4d9c-8b7b-7f987f026407 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:37.237776 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1eac1a86-07a8-4d9c-8b7b-7f987f026407 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:37.364487 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1eac1a86-07a8-4d9c-8b7b-7f987f026407 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:37.372128 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1eac1a86-07a8-4d9c-8b7b-7f987f026407 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1314 microversion: 2.1 time: 0.148628 Sep 05 12:28:37.372699 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 398/800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:37 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:37.905759 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e4615e02-08e2-48b0-a063-3b8705a7fe13 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:37.906364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e4615e02-08e2-48b0-a063-3b8705a7fe13 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:37.912928 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e4615e02-08e2-48b0-a063-3b8705a7fe13 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:37.913409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e4615e02-08e2-48b0-a063-3b8705a7fe13 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:37.913857 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e4615e02-08e2-48b0-a063-3b8705a7fe13 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:37.914553 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e4615e02-08e2-48b0-a063-3b8705a7fe13 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:37.915010 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e4615e02-08e2-48b0-a063-3b8705a7fe13 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:37.915435 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e4615e02-08e2-48b0-a063-3b8705a7fe13 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:38.045216 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e4615e02-08e2-48b0-a063-3b8705a7fe13 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:38.053307 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e4615e02-08e2-48b0-a063-3b8705a7fe13 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:38.054747 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e4615e02-08e2-48b0-a063-3b8705a7fe13 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:38.055930 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e4615e02-08e2-48b0-a063-3b8705a7fe13 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1723 microversion: 2.20 time: 0.154967 Sep 05 12:28:38.056507 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 403/801] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:37 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:38.395473 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-dcff90e9-c4fc-4407-b631-6ac1fc624464 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:38.396407 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-dcff90e9-c4fc-4407-b631-6ac1fc624464 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:38.402988 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dcff90e9-c4fc-4407-b631-6ac1fc624464 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:38.403784 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dcff90e9-c4fc-4407-b631-6ac1fc624464 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:38.404230 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dcff90e9-c4fc-4407-b631-6ac1fc624464 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:38.404925 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dcff90e9-c4fc-4407-b631-6ac1fc624464 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:38.405383 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dcff90e9-c4fc-4407-b631-6ac1fc624464 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:38.405818 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dcff90e9-c4fc-4407-b631-6ac1fc624464 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:38.632298 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-dcff90e9-c4fc-4407-b631-6ac1fc624464 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:38.639976 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-dcff90e9-c4fc-4407-b631-6ac1fc624464 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1314 microversion: 2.1 time: 0.249492 Sep 05 12:28:38.640556 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 399/802] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:38 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:39.081815 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-de46bb59-9a29-4cc7-8434-a3b4dc41f7d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:39.082375 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-de46bb59-9a29-4cc7-8434-a3b4dc41f7d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:39.088803 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de46bb59-9a29-4cc7-8434-a3b4dc41f7d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:39.089288 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de46bb59-9a29-4cc7-8434-a3b4dc41f7d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:39.089721 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de46bb59-9a29-4cc7-8434-a3b4dc41f7d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:39.090413 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de46bb59-9a29-4cc7-8434-a3b4dc41f7d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:39.090870 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de46bb59-9a29-4cc7-8434-a3b4dc41f7d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:39.091812 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de46bb59-9a29-4cc7-8434-a3b4dc41f7d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:39.229357 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-de46bb59-9a29-4cc7-8434-a3b4dc41f7d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:39.237383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-de46bb59-9a29-4cc7-8434-a3b4dc41f7d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:39.238840 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-de46bb59-9a29-4cc7-8434-a3b4dc41f7d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:39.240044 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-de46bb59-9a29-4cc7-8434-a3b4dc41f7d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1723 microversion: 2.20 time: 0.162246 Sep 05 12:28:39.240604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 404/803] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:39 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:39.663366 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-959f5d30-06fe-489c-86e4-63ac7ca447bb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:39.663930 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-959f5d30-06fe-489c-86e4-63ac7ca447bb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:39.670364 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-959f5d30-06fe-489c-86e4-63ac7ca447bb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:39.670840 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-959f5d30-06fe-489c-86e4-63ac7ca447bb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:39.671269 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-959f5d30-06fe-489c-86e4-63ac7ca447bb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:39.671974 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-959f5d30-06fe-489c-86e4-63ac7ca447bb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:39.672423 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-959f5d30-06fe-489c-86e4-63ac7ca447bb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:39.672838 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-959f5d30-06fe-489c-86e4-63ac7ca447bb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:39.801347 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-959f5d30-06fe-489c-86e4-63ac7ca447bb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:39.810225 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-959f5d30-06fe-489c-86e4-63ac7ca447bb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1314 microversion: 2.1 time: 0.150382 Sep 05 12:28:39.810786 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 400/804] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:39 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:40.264537 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5296518f-a337-4b50-a145-a47f82729bcb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:40.265152 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5296518f-a337-4b50-a145-a47f82729bcb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:40.271744 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5296518f-a337-4b50-a145-a47f82729bcb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:40.272223 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5296518f-a337-4b50-a145-a47f82729bcb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:40.272658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5296518f-a337-4b50-a145-a47f82729bcb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:40.273343 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5296518f-a337-4b50-a145-a47f82729bcb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:40.273800 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5296518f-a337-4b50-a145-a47f82729bcb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:40.274225 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5296518f-a337-4b50-a145-a47f82729bcb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:40.402302 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5296518f-a337-4b50-a145-a47f82729bcb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:40.411049 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5296518f-a337-4b50-a145-a47f82729bcb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:40.412506 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5296518f-a337-4b50-a145-a47f82729bcb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:40.413650 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5296518f-a337-4b50-a145-a47f82729bcb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1723 microversion: 2.20 time: 0.153092 Sep 05 12:28:40.414201 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 405/805] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:40 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:40.832476 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-32555d74-30af-4fa3-b1fe-ea80a31ca82f tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:40.833080 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-32555d74-30af-4fa3-b1fe-ea80a31ca82f tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:40.839459 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-32555d74-30af-4fa3-b1fe-ea80a31ca82f tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:40.839966 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-32555d74-30af-4fa3-b1fe-ea80a31ca82f tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:40.840395 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-32555d74-30af-4fa3-b1fe-ea80a31ca82f tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:40.841729 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-32555d74-30af-4fa3-b1fe-ea80a31ca82f tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:40.842180 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-32555d74-30af-4fa3-b1fe-ea80a31ca82f tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:40.842597 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-32555d74-30af-4fa3-b1fe-ea80a31ca82f tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:40.972929 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-32555d74-30af-4fa3-b1fe-ea80a31ca82f tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:40.981222 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-32555d74-30af-4fa3-b1fe-ea80a31ca82f tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1314 microversion: 2.1 time: 0.152516 Sep 05 12:28:40.981800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 401/806] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:40 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:41.441641 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-55f0a731-c432-4ff5-99fe-c6dea08d7777 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:41.442260 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-55f0a731-c432-4ff5-99fe-c6dea08d7777 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:41.448831 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-55f0a731-c432-4ff5-99fe-c6dea08d7777 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:41.449318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-55f0a731-c432-4ff5-99fe-c6dea08d7777 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:41.449759 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-55f0a731-c432-4ff5-99fe-c6dea08d7777 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:41.450491 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-55f0a731-c432-4ff5-99fe-c6dea08d7777 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:41.450976 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-55f0a731-c432-4ff5-99fe-c6dea08d7777 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:41.451385 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-55f0a731-c432-4ff5-99fe-c6dea08d7777 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:41.579730 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-55f0a731-c432-4ff5-99fe-c6dea08d7777 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:41.587752 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-55f0a731-c432-4ff5-99fe-c6dea08d7777 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:41.589180 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-55f0a731-c432-4ff5-99fe-c6dea08d7777 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:41.590323 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-55f0a731-c432-4ff5-99fe-c6dea08d7777 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1744 microversion: 2.20 time: 0.153738 Sep 05 12:28:41.590873 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 406/807] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:41 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:28:42.006034 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c9e109fa-d2b3-44d1-85eb-af93224c3cfb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:42.006798 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c9e109fa-d2b3-44d1-85eb-af93224c3cfb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:42.013462 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c9e109fa-d2b3-44d1-85eb-af93224c3cfb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:42.013976 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c9e109fa-d2b3-44d1-85eb-af93224c3cfb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:42.014467 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c9e109fa-d2b3-44d1-85eb-af93224c3cfb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:42.015079 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c9e109fa-d2b3-44d1-85eb-af93224c3cfb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:42.015547 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c9e109fa-d2b3-44d1-85eb-af93224c3cfb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:42.015978 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c9e109fa-d2b3-44d1-85eb-af93224c3cfb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:42.149548 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c9e109fa-d2b3-44d1-85eb-af93224c3cfb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:42.158896 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c9e109fa-d2b3-44d1-85eb-af93224c3cfb tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1314 microversion: 2.1 time: 0.156942 Sep 05 12:28:42.159458 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 402/808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:42 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:42.443882 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-8c8cff2e-e85d-49d7-a40e-05b9486ed76f req-d1f7c6ed-29a1-4586-9c8e-30dd887f6b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af96fecc-6ff9-4be8-8598-e1bc2b672be9", "name": "network-vif-plugged", "status": "completed", "tag": "0fa4eae4-323f-4d5f-8955-0b0e3843a896"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:28:42.454280 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-8c8cff2e-e85d-49d7-a40e-05b9486ed76f req-d1f7c6ed-29a1-4586-9c8e-30dd887f6b1e service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:42.454758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-8c8cff2e-e85d-49d7-a40e-05b9486ed76f req-d1f7c6ed-29a1-4586-9c8e-30dd887f6b1e service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:42.455222 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-8c8cff2e-e85d-49d7-a40e-05b9486ed76f req-d1f7c6ed-29a1-4586-9c8e-30dd887f6b1e service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:42.466063 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-8c8cff2e-e85d-49d7-a40e-05b9486ed76f req-d1f7c6ed-29a1-4586-9c8e-30dd887f6b1e service nova] Creating event network-vif-plugged:0fa4eae4-323f-4d5f-8955-0b0e3843a896 for instance af96fecc-6ff9-4be8-8598-e1bc2b672be9 on hv-cinder-85518 Sep 05 12:28:42.471635 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-8c8cff2e-e85d-49d7-a40e-05b9486ed76f req-d1f7c6ed-29a1-4586-9c8e-30dd887f6b1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031523 Sep 05 12:28:42.472205 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 407/809] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:28:42.616082 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d295e10e-b3ef-48d4-9f7c-0e4dc29a16f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:42.616611 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d295e10e-b3ef-48d4-9f7c-0e4dc29a16f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:42.618579 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:28:42.622603 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=6 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:28:42.625676 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d295e10e-b3ef-48d4-9f7c-0e4dc29a16f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:42.626154 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d295e10e-b3ef-48d4-9f7c-0e4dc29a16f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:42.626584 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d295e10e-b3ef-48d4-9f7c-0e4dc29a16f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:42.627310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d295e10e-b3ef-48d4-9f7c-0e4dc29a16f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:42.627790 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d295e10e-b3ef-48d4-9f7c-0e4dc29a16f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:42.628215 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d295e10e-b3ef-48d4-9f7c-0e4dc29a16f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:42.821868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d295e10e-b3ef-48d4-9f7c-0e4dc29a16f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:42.830867 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d295e10e-b3ef-48d4-9f7c-0e4dc29a16f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:42.832344 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d295e10e-b3ef-48d4-9f7c-0e4dc29a16f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:42.833513 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d295e10e-b3ef-48d4-9f7c-0e4dc29a16f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1744 microversion: 2.20 time: 0.221482 Sep 05 12:28:42.834068 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 403/810] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:42 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:43.178626 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:28:43.183467 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a2d2b84a-77f7-46c4-907d-6f74229b2e9e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:43.184202 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a2d2b84a-77f7-46c4-907d-6f74229b2e9e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:43.191723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2d2b84a-77f7-46c4-907d-6f74229b2e9e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:43.192210 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2d2b84a-77f7-46c4-907d-6f74229b2e9e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:43.192647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2d2b84a-77f7-46c4-907d-6f74229b2e9e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:43.193339 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2d2b84a-77f7-46c4-907d-6f74229b2e9e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:43.193793 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2d2b84a-77f7-46c4-907d-6f74229b2e9e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:43.194218 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2d2b84a-77f7-46c4-907d-6f74229b2e9e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:43.328556 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a2d2b84a-77f7-46c4-907d-6f74229b2e9e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:43.336612 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a2d2b84a-77f7-46c4-907d-6f74229b2e9e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1314 microversion: 2.1 time: 0.158948 Sep 05 12:28:43.337167 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 408/811] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:43 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:43.858541 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9dae10e4-8763-42c3-b0a9-5ef7a32e2b32 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:43.859155 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-9dae10e4-8763-42c3-b0a9-5ef7a32e2b32 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:43.865612 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9dae10e4-8763-42c3-b0a9-5ef7a32e2b32 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:43.866095 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9dae10e4-8763-42c3-b0a9-5ef7a32e2b32 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:43.866537 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9dae10e4-8763-42c3-b0a9-5ef7a32e2b32 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:43.867221 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9dae10e4-8763-42c3-b0a9-5ef7a32e2b32 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:43.867719 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9dae10e4-8763-42c3-b0a9-5ef7a32e2b32 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:43.868151 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9dae10e4-8763-42c3-b0a9-5ef7a32e2b32 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:44.110209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-9dae10e4-8763-42c3-b0a9-5ef7a32e2b32 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:44.118589 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-9dae10e4-8763-42c3-b0a9-5ef7a32e2b32 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:44.120123 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-9dae10e4-8763-42c3-b0a9-5ef7a32e2b32 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:44.121303 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9dae10e4-8763-42c3-b0a9-5ef7a32e2b32 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1744 microversion: 2.20 time: 0.266658 Sep 05 12:28:44.121870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 404/812] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:43 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1744 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:44.360573 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a2ef3c7f-ec9f-4b0f-a981-2bf175c55122 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:44.361237 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a2ef3c7f-ec9f-4b0f-a981-2bf175c55122 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:44.368226 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2ef3c7f-ec9f-4b0f-a981-2bf175c55122 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:44.368722 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2ef3c7f-ec9f-4b0f-a981-2bf175c55122 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:44.369163 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2ef3c7f-ec9f-4b0f-a981-2bf175c55122 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:44.369881 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2ef3c7f-ec9f-4b0f-a981-2bf175c55122 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:44.370344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2ef3c7f-ec9f-4b0f-a981-2bf175c55122 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:44.370775 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2ef3c7f-ec9f-4b0f-a981-2bf175c55122 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:44.517241 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a2ef3c7f-ec9f-4b0f-a981-2bf175c55122 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:44.525393 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a2ef3c7f-ec9f-4b0f-a981-2bf175c55122 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1314 microversion: 2.1 time: 0.169596 Sep 05 12:28:44.526058 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 409/813] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:44 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:45.147563 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-db6d50db-14b1-4504-8084-e3b02529416c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:45.148175 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-db6d50db-14b1-4504-8084-e3b02529416c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:45.155421 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-db6d50db-14b1-4504-8084-e3b02529416c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:45.155935 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-db6d50db-14b1-4504-8084-e3b02529416c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:45.156368 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-db6d50db-14b1-4504-8084-e3b02529416c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:45.157072 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-db6d50db-14b1-4504-8084-e3b02529416c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:45.157515 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-db6d50db-14b1-4504-8084-e3b02529416c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:45.157934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-db6d50db-14b1-4504-8084-e3b02529416c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:45.292554 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-db6d50db-14b1-4504-8084-e3b02529416c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:45.301451 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-db6d50db-14b1-4504-8084-e3b02529416c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:45.302887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-db6d50db-14b1-4504-8084-e3b02529416c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:45.304071 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-db6d50db-14b1-4504-8084-e3b02529416c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1744 microversion: 2.20 time: 0.160379 Sep 05 12:28:45.304627 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 405/814] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:45 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:45.548725 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d5e1e2aa-8050-420a-a7af-6e09f6507520 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:45.549339 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d5e1e2aa-8050-420a-a7af-6e09f6507520 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:45.555752 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d5e1e2aa-8050-420a-a7af-6e09f6507520 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:45.556235 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d5e1e2aa-8050-420a-a7af-6e09f6507520 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:45.556672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d5e1e2aa-8050-420a-a7af-6e09f6507520 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:45.557364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d5e1e2aa-8050-420a-a7af-6e09f6507520 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:45.557830 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d5e1e2aa-8050-420a-a7af-6e09f6507520 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:45.558258 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d5e1e2aa-8050-420a-a7af-6e09f6507520 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:45.691442 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-d5e1e2aa-8050-420a-a7af-6e09f6507520 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:45.699101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d5e1e2aa-8050-420a-a7af-6e09f6507520 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1499 microversion: 2.1 time: 0.154376 Sep 05 12:28:45.699688 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 410/815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:45 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:46.222933 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2468cf92-90bc-4bbe-852a-1c58ce9ca695 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:46.223447 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2468cf92-90bc-4bbe-852a-1c58ce9ca695 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:46.229948 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2468cf92-90bc-4bbe-852a-1c58ce9ca695 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:46.230434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2468cf92-90bc-4bbe-852a-1c58ce9ca695 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:46.230871 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2468cf92-90bc-4bbe-852a-1c58ce9ca695 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:46.231585 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2468cf92-90bc-4bbe-852a-1c58ce9ca695 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:46.232042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2468cf92-90bc-4bbe-852a-1c58ce9ca695 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:46.232471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2468cf92-90bc-4bbe-852a-1c58ce9ca695 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:46.257986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2468cf92-90bc-4bbe-852a-1c58ce9ca695 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Going to try to terminate instance {{(pid=120535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:28:46.260749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:28:46.329555 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5ba00877-48ff-407a-9c04-3ff679aad9c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:46.330381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5ba00877-48ff-407a-9c04-3ff679aad9c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:46.338846 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5ba00877-48ff-407a-9c04-3ff679aad9c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:46.339852 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5ba00877-48ff-407a-9c04-3ff679aad9c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:46.340652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5ba00877-48ff-407a-9c04-3ff679aad9c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:46.341851 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5ba00877-48ff-407a-9c04-3ff679aad9c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:46.342096 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2468cf92-90bc-4bbe-852a-1c58ce9ca695 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "DELETE /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 204 len: 0 microversion: 2.1 time: 0.121594 Sep 05 12:28:46.342947 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5ba00877-48ff-407a-9c04-3ff679aad9c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:46.343378 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5ba00877-48ff-407a-9c04-3ff679aad9c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:46.347684 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 406/816] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:28:46 2022] DELETE /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:28:46.353106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7f3e2d51-5c5e-4c67-98f7-5f81624c07bc tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:46.354373 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7f3e2d51-5c5e-4c67-98f7-5f81624c07bc tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:46.361316 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f3e2d51-5c5e-4c67-98f7-5f81624c07bc tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:46.362000 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f3e2d51-5c5e-4c67-98f7-5f81624c07bc tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:46.362543 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f3e2d51-5c5e-4c67-98f7-5f81624c07bc tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:46.363354 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f3e2d51-5c5e-4c67-98f7-5f81624c07bc tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:46.363937 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f3e2d51-5c5e-4c67-98f7-5f81624c07bc tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:46.364554 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f3e2d51-5c5e-4c67-98f7-5f81624c07bc tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:46.485351 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5ba00877-48ff-407a-9c04-3ff679aad9c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:46.494211 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5ba00877-48ff-407a-9c04-3ff679aad9c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:46.495892 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5ba00877-48ff-407a-9c04-3ff679aad9c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:46.497409 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5ba00877-48ff-407a-9c04-3ff679aad9c2 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1744 microversion: 2.20 time: 0.172654 Sep 05 12:28:46.498207 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 411/817] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:46 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:46.503576 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-9c67c345-f9b5-49b7-9311-5ff369d488d0 req-4374c0b7-9f21-484e-90b9-c556d11a5b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0055a73c-7732-48a3-b76b-3b8cc28e7804", "name": "network-vif-plugged", "status": "completed", "tag": "a65b6d21-8474-43a9-bb2b-2b6a76c853f9"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:28:46.514693 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-9c67c345-f9b5-49b7-9311-5ff369d488d0 req-4374c0b7-9f21-484e-90b9-c556d11a5b81 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:46.515179 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-9c67c345-f9b5-49b7-9311-5ff369d488d0 req-4374c0b7-9f21-484e-90b9-c556d11a5b81 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:46.515641 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-9c67c345-f9b5-49b7-9311-5ff369d488d0 req-4374c0b7-9f21-484e-90b9-c556d11a5b81 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:46.517166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-7f3e2d51-5c5e-4c67-98f7-5f81624c07bc tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:46.524909 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7f3e2d51-5c5e-4c67-98f7-5f81624c07bc tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1505 microversion: 2.1 time: 0.175842 Sep 05 12:28:46.525647 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 407/818] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:46 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:46.527714 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-9c67c345-f9b5-49b7-9311-5ff369d488d0 req-4374c0b7-9f21-484e-90b9-c556d11a5b81 service nova] Creating event network-vif-plugged:a65b6d21-8474-43a9-bb2b-2b6a76c853f9 for instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 on hv-cinder-85518 Sep 05 12:28:46.541591 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-9c67c345-f9b5-49b7-9311-5ff369d488d0 req-4374c0b7-9f21-484e-90b9-c556d11a5b81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042080 Sep 05 12:28:46.542233 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 412/819] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:28:47.522225 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5d1306e8-0ce8-4acb-b106-f93a1b339024 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:47.522834 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5d1306e8-0ce8-4acb-b106-f93a1b339024 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:47.529591 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5d1306e8-0ce8-4acb-b106-f93a1b339024 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:47.530141 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5d1306e8-0ce8-4acb-b106-f93a1b339024 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:47.530557 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5d1306e8-0ce8-4acb-b106-f93a1b339024 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:47.531246 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5d1306e8-0ce8-4acb-b106-f93a1b339024 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:47.531750 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5d1306e8-0ce8-4acb-b106-f93a1b339024 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:47.532182 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5d1306e8-0ce8-4acb-b106-f93a1b339024 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:47.552208 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0188f048-4a92-43a6-88f0-7e5845154242 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:47.552910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0188f048-4a92-43a6-88f0-7e5845154242 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:47.558890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0188f048-4a92-43a6-88f0-7e5845154242 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:47.559370 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0188f048-4a92-43a6-88f0-7e5845154242 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:47.559851 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0188f048-4a92-43a6-88f0-7e5845154242 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:47.560543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0188f048-4a92-43a6-88f0-7e5845154242 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:47.561585 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0188f048-4a92-43a6-88f0-7e5845154242 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:47.562025 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0188f048-4a92-43a6-88f0-7e5845154242 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:47.661101 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5d1306e8-0ce8-4acb-b106-f93a1b339024 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:47.669182 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5d1306e8-0ce8-4acb-b106-f93a1b339024 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:47.671105 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5d1306e8-0ce8-4acb-b106-f93a1b339024 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:47.672322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5d1306e8-0ce8-4acb-b106-f93a1b339024 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1744 microversion: 2.20 time: 0.154003 Sep 05 12:28:47.672870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 408/820] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:47 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:47.695428 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0188f048-4a92-43a6-88f0-7e5845154242 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:47.703238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0188f048-4a92-43a6-88f0-7e5845154242 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1505 microversion: 2.1 time: 0.155844 Sep 05 12:28:47.703837 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 413/821] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:47 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:28:48.697630 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-bb4641dd-ffbb-4864-953d-0ba77cd743a8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:48.698217 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-bb4641dd-ffbb-4864-953d-0ba77cd743a8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:48.705015 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bb4641dd-ffbb-4864-953d-0ba77cd743a8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:48.705509 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bb4641dd-ffbb-4864-953d-0ba77cd743a8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:48.706020 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bb4641dd-ffbb-4864-953d-0ba77cd743a8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:48.706739 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bb4641dd-ffbb-4864-953d-0ba77cd743a8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:48.707200 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bb4641dd-ffbb-4864-953d-0ba77cd743a8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:48.707654 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bb4641dd-ffbb-4864-953d-0ba77cd743a8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:48.727138 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-54243c30-292e-4b6f-b2fb-52ab2294c145 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:48.727903 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-54243c30-292e-4b6f-b2fb-52ab2294c145 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:48.736286 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-54243c30-292e-4b6f-b2fb-52ab2294c145 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:48.736777 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-54243c30-292e-4b6f-b2fb-52ab2294c145 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:48.737266 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-54243c30-292e-4b6f-b2fb-52ab2294c145 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:48.738458 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-54243c30-292e-4b6f-b2fb-52ab2294c145 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:48.738458 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-54243c30-292e-4b6f-b2fb-52ab2294c145 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:48.738894 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-54243c30-292e-4b6f-b2fb-52ab2294c145 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:48.743384 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=100 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:28:48.914771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-bb4641dd-ffbb-4864-953d-0ba77cd743a8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:48.930810 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-bb4641dd-ffbb-4864-953d-0ba77cd743a8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:48.932435 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-bb4641dd-ffbb-4864-953d-0ba77cd743a8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:48.935692 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-bb4641dd-ffbb-4864-953d-0ba77cd743a8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1744 microversion: 2.20 time: 0.242129 Sep 05 12:28:48.939150 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-54243c30-292e-4b6f-b2fb-52ab2294c145 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:48.955603 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 409/822] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:48 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1744 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:48.956393 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-54243c30-292e-4b6f-b2fb-52ab2294c145 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 200 len: 1505 microversion: 2.1 time: 0.233837 Sep 05 12:28:48.957153 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 414/823] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:48 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 1505 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:49.078998 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-286be392-3660-4aef-8eac-a836d6af1a1e req-9a769ba6-b0e2-4f78-a50a-b440a6dd7d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af96fecc-6ff9-4be8-8598-e1bc2b672be9", "name": "network-vif-deleted", "tag": "0fa4eae4-323f-4d5f-8955-0b0e3843a896"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:28:49.095812 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-286be392-3660-4aef-8eac-a836d6af1a1e req-9a769ba6-b0e2-4f78-a50a-b440a6dd7d44 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:49.096299 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-286be392-3660-4aef-8eac-a836d6af1a1e req-9a769ba6-b0e2-4f78-a50a-b440a6dd7d44 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:49.096725 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-286be392-3660-4aef-8eac-a836d6af1a1e req-9a769ba6-b0e2-4f78-a50a-b440a6dd7d44 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:49.109108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-286be392-3660-4aef-8eac-a836d6af1a1e req-9a769ba6-b0e2-4f78-a50a-b440a6dd7d44 service nova] Creating event network-vif-deleted:0fa4eae4-323f-4d5f-8955-0b0e3843a896 for instance af96fecc-6ff9-4be8-8598-e1bc2b672be9 on hv-cinder-85518 Sep 05 12:28:49.117327 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-286be392-3660-4aef-8eac-a836d6af1a1e req-9a769ba6-b0e2-4f78-a50a-b440a6dd7d44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042971 Sep 05 12:28:49.117925 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 410/824] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:28:49.962342 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-25c591b8-69a7-4467-a7d0-25b0934eca81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:49.962994 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-25c591b8-69a7-4467-a7d0-25b0934eca81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:49.969926 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-25c591b8-69a7-4467-a7d0-25b0934eca81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:49.970420 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-25c591b8-69a7-4467-a7d0-25b0934eca81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:49.970859 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-25c591b8-69a7-4467-a7d0-25b0934eca81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:49.971604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-25c591b8-69a7-4467-a7d0-25b0934eca81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:49.972078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-25c591b8-69a7-4467-a7d0-25b0934eca81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:49.972513 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-25c591b8-69a7-4467-a7d0-25b0934eca81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:49.982166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-cd33d67a-f926-4558-b2ee-3aab8fc7b989 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:49.983703 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-cd33d67a-f926-4558-b2ee-3aab8fc7b989 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: af96fecc-6ff9-4be8-8598-e1bc2b672be9] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:49.991769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd33d67a-f926-4558-b2ee-3aab8fc7b989 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:49.992565 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd33d67a-f926-4558-b2ee-3aab8fc7b989 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:49.993936 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd33d67a-f926-4558-b2ee-3aab8fc7b989 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:49.994892 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd33d67a-f926-4558-b2ee-3aab8fc7b989 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:49.995561 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd33d67a-f926-4558-b2ee-3aab8fc7b989 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:49.996053 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd33d67a-f926-4558-b2ee-3aab8fc7b989 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:50.011921 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-cd33d67a-f926-4558-b2ee-3aab8fc7b989 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] HTTP exception thrown: Instance af96fecc-6ff9-4be8-8598-e1bc2b672be9 could not be found. Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-cd33d67a-f926-4558-b2ee-3aab8fc7b989 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Request method failure captured: Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 HTTP/1.1 Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFetuEk6QAe8RGeYQjDbPgVikojAc03CEKFxFyu696ORvrwuvfV471hXXQQzTlYTY_LUfDs9tJXIBSBmxJ0hJsxlb1YMhhspigS7RxdeCJiWDKPNSbS8Wug9qS2noaKRyNgbhxAdqxrtx27JLHTOkpzCZKWOvFwICfLhYxBkGzNtCNvY Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 1645a9dd82b14c25892cec9be947f310 Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-VolumesActionsTest-1592267262 Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:28:50.014749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:28:50.016491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1645a9dd82b14c25892cec9be947f310", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1645a9dd82b14c25892cec9be947f310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1645a9dd82b14c25892cec9be947f310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1645a9dd82b14c25892cec9be947f310"}]}] Sep 05 12:28:50.016491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-VolumesActionsTest-1592267262 Sep 05 12:28:50.016491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 1645a9dd82b14c25892cec9be947f310 Sep 05 12:28:50.016491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-VolumesActionsTest-1592267262 Sep 05 12:28:50.016491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-VolumesActionsTest-1592267262-project Sep 05 12:28:50.016491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:28:50.016491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:28:50.016491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: 51ad1f400be2465dbfb4a14698247496 Sep 05 12:28:50.016491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-VolumesActionsTest-1592267262-project Sep 05 12:28:50.016491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:28:50.016491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance af96fecc-6ff9-4be8-8598-e1bc2b672be9 could not be found. Sep 05 12:28:50.016491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': 'af96fecc-6ff9-4be8-8598-e1bc2b672be9'} Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af96fecc-6ff9-4be8-8598-e1bc2b672be9 could not be found. Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:28:50.017474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af96fecc-6ff9-4be8-8598-e1bc2b672be9 could not be found. Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af96fecc-6ff9-4be8-8598-e1bc2b672be9 could not be found. Sep 05 12:28:50.019016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:28:50.022451 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-cd33d67a-f926-4558-b2ee-3aab8fc7b989 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Returning 404 to user: Instance af96fecc-6ff9-4be8-8598-e1bc2b672be9 could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:28:50.023478 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-cd33d67a-f926-4558-b2ee-3aab8fc7b989 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9" status: 404 len: 111 microversion: 2.1 time: 0.047189 Sep 05 12:28:50.035798 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 411/825] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:49 2022] GET /compute/v2.1/servers/af96fecc-6ff9-4be8-8598-e1bc2b672be9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:28:50.129713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-25c591b8-69a7-4467-a7d0-25b0934eca81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:50.139923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-25c591b8-69a7-4467-a7d0-25b0934eca81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:50.141725 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-25c591b8-69a7-4467-a7d0-25b0934eca81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:50.142942 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-25c591b8-69a7-4467-a7d0-25b0934eca81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1739 microversion: 2.20 time: 0.184608 Sep 05 12:28:50.160267 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 415/826] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:49 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:50.267037 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1569415044", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "networks": [{"uuid": "0358ea68-d230-42b8-ae52-c227d3ce766b"}]}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:28:50.324033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.network.neutron [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] validate_networks() for [('0358ea68-d230-42b8-ae52-c227d3ce766b', None, None, None, None, None)] {{(pid=120535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:28:50.706275 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Flavor limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:28:50.706771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Image limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:28:50.707296 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Flavor pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:28:50.707776 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Image pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:28:50.708192 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:28:50.719771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:50.720438 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:50.721014 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:50.721842 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:50.722413 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:50.722929 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:50.742275 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Getting quotas for project 1645a9dd82b14c25892cec9be947f310. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:28:50.746535 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Getting quotas for user 51ad1f400be2465dbfb4a14698247496 and project 1645a9dd82b14c25892cec9be947f310. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:28:50.758005 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Going to run 1 instances... {{(pid=120535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:28:50.760282 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:28:50.814985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6ab65d0f-ef28-493e-932b-9fd8aedd23bd tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551902 Sep 05 12:28:50.815999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 412/827] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:28:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 05 12:28:50.827061 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-88545911-a4be-4ca1-8baf-61c7a2304d02 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:50.827999 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-88545911-a4be-4ca1-8baf-61c7a2304d02 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:50.896340 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-88545911-a4be-4ca1-8baf-61c7a2304d02 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:50.904499 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-88545911-a4be-4ca1-8baf-61c7a2304d02 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1214 microversion: 2.1 time: 0.081568 Sep 05 12:28:50.906157 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 416/828] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:50 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:51.174205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-993b391b-0e6d-4e47-bd4a-819ebeefdd55 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:51.175576 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-993b391b-0e6d-4e47-bd4a-819ebeefdd55 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:51.183710 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-993b391b-0e6d-4e47-bd4a-819ebeefdd55 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:51.184874 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-993b391b-0e6d-4e47-bd4a-819ebeefdd55 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:51.185733 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-993b391b-0e6d-4e47-bd4a-819ebeefdd55 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:51.188184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-993b391b-0e6d-4e47-bd4a-819ebeefdd55 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:51.188881 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-993b391b-0e6d-4e47-bd4a-819ebeefdd55 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:51.189559 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-993b391b-0e6d-4e47-bd4a-819ebeefdd55 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:51.347241 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-993b391b-0e6d-4e47-bd4a-819ebeefdd55 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:51.356278 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-993b391b-0e6d-4e47-bd4a-819ebeefdd55 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:51.358794 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-993b391b-0e6d-4e47-bd4a-819ebeefdd55 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:51.360251 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-993b391b-0e6d-4e47-bd4a-819ebeefdd55 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1739 microversion: 2.20 time: 0.192454 Sep 05 12:28:51.372010 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 413/829] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:51 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:51.927998 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7afad527-c0be-4661-b148-c7ccffa98c5e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:51.928583 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7afad527-c0be-4661-b148-c7ccffa98c5e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:51.935356 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7afad527-c0be-4661-b148-c7ccffa98c5e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:51.935869 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7afad527-c0be-4661-b148-c7ccffa98c5e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:51.936835 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7afad527-c0be-4661-b148-c7ccffa98c5e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:51.937530 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7afad527-c0be-4661-b148-c7ccffa98c5e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:51.938083 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7afad527-c0be-4661-b148-c7ccffa98c5e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:51.938400 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7afad527-c0be-4661-b148-c7ccffa98c5e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:52.005721 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7afad527-c0be-4661-b148-c7ccffa98c5e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:52.014061 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7afad527-c0be-4661-b148-c7ccffa98c5e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1266 microversion: 2.1 time: 0.089925 Sep 05 12:28:52.027687 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 417/830] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:51 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:52.387396 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2cdbf2f5-cdb0-4e3b-a33a-fa490f32403f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:52.388318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2cdbf2f5-cdb0-4e3b-a33a-fa490f32403f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:52.399991 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2cdbf2f5-cdb0-4e3b-a33a-fa490f32403f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:52.400817 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2cdbf2f5-cdb0-4e3b-a33a-fa490f32403f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:52.401506 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2cdbf2f5-cdb0-4e3b-a33a-fa490f32403f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:52.403028 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2cdbf2f5-cdb0-4e3b-a33a-fa490f32403f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:52.404023 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2cdbf2f5-cdb0-4e3b-a33a-fa490f32403f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:52.405217 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2cdbf2f5-cdb0-4e3b-a33a-fa490f32403f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:52.868131 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2cdbf2f5-cdb0-4e3b-a33a-fa490f32403f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:52.878692 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2cdbf2f5-cdb0-4e3b-a33a-fa490f32403f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:52.882328 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2cdbf2f5-cdb0-4e3b-a33a-fa490f32403f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:52.884703 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2cdbf2f5-cdb0-4e3b-a33a-fa490f32403f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1739 microversion: 2.20 time: 0.501843 Sep 05 12:28:52.905746 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 414/831] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:52 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1739 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:28:53.039433 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0935290c-6f95-45e7-9700-76b1089aec50 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:53.040685 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0935290c-6f95-45e7-9700-76b1089aec50 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:53.048429 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0935290c-6f95-45e7-9700-76b1089aec50 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:53.049290 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0935290c-6f95-45e7-9700-76b1089aec50 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:53.050171 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0935290c-6f95-45e7-9700-76b1089aec50 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:53.051291 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0935290c-6f95-45e7-9700-76b1089aec50 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:53.052295 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0935290c-6f95-45e7-9700-76b1089aec50 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:53.053109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0935290c-6f95-45e7-9700-76b1089aec50 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:53.231776 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0935290c-6f95-45e7-9700-76b1089aec50 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:53.241597 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0935290c-6f95-45e7-9700-76b1089aec50 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1314 microversion: 2.1 time: 0.207533 Sep 05 12:28:53.243391 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 418/832] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:53 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:53.881012 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-4a52f1e9-f1e2-4708-b0e8-9bc79afb88f1 req-eb2dbaa0-f54b-4428-afd1-032474c3ea83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48cf8078-4e41-45ba-981c-9fd3fbb15165", "tag": "f1060543-ad44-4f1a-bf19-dd96ac5985cf"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:28:53.898909 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-4a52f1e9-f1e2-4708-b0e8-9bc79afb88f1 req-eb2dbaa0-f54b-4428-afd1-032474c3ea83 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:53.900158 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-4a52f1e9-f1e2-4708-b0e8-9bc79afb88f1 req-eb2dbaa0-f54b-4428-afd1-032474c3ea83 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:53.901532 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-4a52f1e9-f1e2-4708-b0e8-9bc79afb88f1 req-eb2dbaa0-f54b-4428-afd1-032474c3ea83 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:53.918294 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-4a52f1e9-f1e2-4708-b0e8-9bc79afb88f1 req-eb2dbaa0-f54b-4428-afd1-032474c3ea83 service nova] Creating event network-changed:f1060543-ad44-4f1a-bf19-dd96ac5985cf for instance 48cf8078-4e41-45ba-981c-9fd3fbb15165 on hv-cinder-85518 Sep 05 12:28:53.929941 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4a8140b8-d0bc-4f59-ae64-2c832c572934 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:53.930977 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4a8140b8-d0bc-4f59-ae64-2c832c572934 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:53.933430 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-4a52f1e9-f1e2-4708-b0e8-9bc79afb88f1 req-eb2dbaa0-f54b-4428-afd1-032474c3ea83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057140 Sep 05 12:28:53.935703 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 415/833] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:28:53.942774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4a8140b8-d0bc-4f59-ae64-2c832c572934 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:53.943513 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4a8140b8-d0bc-4f59-ae64-2c832c572934 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:53.944215 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4a8140b8-d0bc-4f59-ae64-2c832c572934 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:53.945094 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4a8140b8-d0bc-4f59-ae64-2c832c572934 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:53.945677 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4a8140b8-d0bc-4f59-ae64-2c832c572934 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:53.946327 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4a8140b8-d0bc-4f59-ae64-2c832c572934 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:54.126086 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4a8140b8-d0bc-4f59-ae64-2c832c572934 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:54.135211 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4a8140b8-d0bc-4f59-ae64-2c832c572934 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:54.136906 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4a8140b8-d0bc-4f59-ae64-2c832c572934 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:54.138475 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4a8140b8-d0bc-4f59-ae64-2c832c572934 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1739 microversion: 2.20 time: 0.214726 Sep 05 12:28:54.139206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 419/834] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:53 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:54.265074 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4fba1e63-080c-487e-bdfd-ee515a955391 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:54.265901 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4fba1e63-080c-487e-bdfd-ee515a955391 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:54.272305 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4fba1e63-080c-487e-bdfd-ee515a955391 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:54.272909 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4fba1e63-080c-487e-bdfd-ee515a955391 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:54.273433 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4fba1e63-080c-487e-bdfd-ee515a955391 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:54.274353 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4fba1e63-080c-487e-bdfd-ee515a955391 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:54.275049 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4fba1e63-080c-487e-bdfd-ee515a955391 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:54.275561 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4fba1e63-080c-487e-bdfd-ee515a955391 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:54.464871 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4fba1e63-080c-487e-bdfd-ee515a955391 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:54.477017 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4fba1e63-080c-487e-bdfd-ee515a955391 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1314 microversion: 2.1 time: 0.216213 Sep 05 12:28:54.477759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 416/835] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:54 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:55.164786 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b26f5275-a2a0-49e2-b7a5-f4f9654db32a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:55.166006 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b26f5275-a2a0-49e2-b7a5-f4f9654db32a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:55.173215 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b26f5275-a2a0-49e2-b7a5-f4f9654db32a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:55.173694 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b26f5275-a2a0-49e2-b7a5-f4f9654db32a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:55.174127 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b26f5275-a2a0-49e2-b7a5-f4f9654db32a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:55.174822 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b26f5275-a2a0-49e2-b7a5-f4f9654db32a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:55.175354 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b26f5275-a2a0-49e2-b7a5-f4f9654db32a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:55.175822 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b26f5275-a2a0-49e2-b7a5-f4f9654db32a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:55.321739 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b26f5275-a2a0-49e2-b7a5-f4f9654db32a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:55.331311 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b26f5275-a2a0-49e2-b7a5-f4f9654db32a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:55.332870 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b26f5275-a2a0-49e2-b7a5-f4f9654db32a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:55.334308 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b26f5275-a2a0-49e2-b7a5-f4f9654db32a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1739 microversion: 2.20 time: 0.173448 Sep 05 12:28:55.334873 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 420/836] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:55 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:55.502025 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a81bd9e2-5e03-419a-acaf-0d0ce91ca915 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:55.502644 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a81bd9e2-5e03-419a-acaf-0d0ce91ca915 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:55.510455 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a81bd9e2-5e03-419a-acaf-0d0ce91ca915 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:55.510949 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a81bd9e2-5e03-419a-acaf-0d0ce91ca915 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:55.511388 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a81bd9e2-5e03-419a-acaf-0d0ce91ca915 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:55.512146 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a81bd9e2-5e03-419a-acaf-0d0ce91ca915 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:55.512619 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a81bd9e2-5e03-419a-acaf-0d0ce91ca915 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:55.513239 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a81bd9e2-5e03-419a-acaf-0d0ce91ca915 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:55.658671 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a81bd9e2-5e03-419a-acaf-0d0ce91ca915 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:55.666776 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a81bd9e2-5e03-419a-acaf-0d0ce91ca915 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1314 microversion: 2.1 time: 0.169746 Sep 05 12:28:55.667340 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 417/837] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:55 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:56.364740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a536a2fb-3287-475a-9ceb-eb0aea109c61 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:56.365403 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a536a2fb-3287-475a-9ceb-eb0aea109c61 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:56.372265 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a536a2fb-3287-475a-9ceb-eb0aea109c61 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:56.372746 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a536a2fb-3287-475a-9ceb-eb0aea109c61 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:56.373171 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a536a2fb-3287-475a-9ceb-eb0aea109c61 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:56.374688 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a536a2fb-3287-475a-9ceb-eb0aea109c61 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:56.375682 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a536a2fb-3287-475a-9ceb-eb0aea109c61 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:56.375682 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a536a2fb-3287-475a-9ceb-eb0aea109c61 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:56.511911 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a536a2fb-3287-475a-9ceb-eb0aea109c61 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:56.522225 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a536a2fb-3287-475a-9ceb-eb0aea109c61 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:56.523752 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a536a2fb-3287-475a-9ceb-eb0aea109c61 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:56.524923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a536a2fb-3287-475a-9ceb-eb0aea109c61 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1739 microversion: 2.20 time: 0.164191 Sep 05 12:28:56.525840 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 421/838] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:56 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:28:56.695155 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e58e74ac-bc2f-4b26-b560-b9de97c5aa6e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:56.701550 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e58e74ac-bc2f-4b26-b560-b9de97c5aa6e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:56.709466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e58e74ac-bc2f-4b26-b560-b9de97c5aa6e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:56.709959 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e58e74ac-bc2f-4b26-b560-b9de97c5aa6e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:56.710650 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e58e74ac-bc2f-4b26-b560-b9de97c5aa6e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:56.711590 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e58e74ac-bc2f-4b26-b560-b9de97c5aa6e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:56.712468 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e58e74ac-bc2f-4b26-b560-b9de97c5aa6e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:56.712865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e58e74ac-bc2f-4b26-b560-b9de97c5aa6e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:56.871921 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e58e74ac-bc2f-4b26-b560-b9de97c5aa6e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:56.880995 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e58e74ac-bc2f-4b26-b560-b9de97c5aa6e tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1314 microversion: 2.1 time: 0.194448 Sep 05 12:28:56.896091 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 418/839] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:56 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:57.550967 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0de13cc1-67ef-41a7-9603-c173372e0ebf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:57.551708 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0de13cc1-67ef-41a7-9603-c173372e0ebf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:57.557781 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=59 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:28:57.561454 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0de13cc1-67ef-41a7-9603-c173372e0ebf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:57.562330 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0de13cc1-67ef-41a7-9603-c173372e0ebf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:57.562923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0de13cc1-67ef-41a7-9603-c173372e0ebf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:57.563859 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0de13cc1-67ef-41a7-9603-c173372e0ebf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:57.566010 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0de13cc1-67ef-41a7-9603-c173372e0ebf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:57.566666 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0de13cc1-67ef-41a7-9603-c173372e0ebf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:57.821888 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0de13cc1-67ef-41a7-9603-c173372e0ebf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:57.831386 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0de13cc1-67ef-41a7-9603-c173372e0ebf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:57.833101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0de13cc1-67ef-41a7-9603-c173372e0ebf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:57.834641 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0de13cc1-67ef-41a7-9603-c173372e0ebf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1739 microversion: 2.20 time: 0.288261 Sep 05 12:28:57.835750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 422/840] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:57 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:57.904732 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d0b23349-9464-44aa-bf3d-97fe3a2080a0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:57.905376 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d0b23349-9464-44aa-bf3d-97fe3a2080a0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:57.925662 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d0b23349-9464-44aa-bf3d-97fe3a2080a0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:57.927117 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d0b23349-9464-44aa-bf3d-97fe3a2080a0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:57.927576 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d0b23349-9464-44aa-bf3d-97fe3a2080a0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:57.928507 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d0b23349-9464-44aa-bf3d-97fe3a2080a0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:57.928962 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d0b23349-9464-44aa-bf3d-97fe3a2080a0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:57.929568 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d0b23349-9464-44aa-bf3d-97fe3a2080a0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:58.079441 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d0b23349-9464-44aa-bf3d-97fe3a2080a0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:58.088696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d0b23349-9464-44aa-bf3d-97fe3a2080a0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1314 microversion: 2.1 time: 0.188068 Sep 05 12:28:58.089605 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 419/841] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:57 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:28:58.860412 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-40d646a6-cfbf-4235-b86e-2ca333ba6520 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:58.861241 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-40d646a6-cfbf-4235-b86e-2ca333ba6520 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:58.868433 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-40d646a6-cfbf-4235-b86e-2ca333ba6520 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:58.868847 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-40d646a6-cfbf-4235-b86e-2ca333ba6520 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:58.869526 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-40d646a6-cfbf-4235-b86e-2ca333ba6520 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:58.870258 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-40d646a6-cfbf-4235-b86e-2ca333ba6520 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:58.870732 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-40d646a6-cfbf-4235-b86e-2ca333ba6520 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:58.871194 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-40d646a6-cfbf-4235-b86e-2ca333ba6520 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:59.036816 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-40d646a6-cfbf-4235-b86e-2ca333ba6520 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:59.046261 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-40d646a6-cfbf-4235-b86e-2ca333ba6520 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:59.047855 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-40d646a6-cfbf-4235-b86e-2ca333ba6520 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:59.049283 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-40d646a6-cfbf-4235-b86e-2ca333ba6520 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1739 microversion: 2.20 time: 0.192958 Sep 05 12:28:59.067827 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 423/842] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:28:58 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:59.112670 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-25f62674-bc61-4c5c-b146-ba9f163f3030 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:28:59.113431 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-25f62674-bc61-4c5c-b146-ba9f163f3030 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:28:59.120493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-25f62674-bc61-4c5c-b146-ba9f163f3030 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:59.120871 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-25f62674-bc61-4c5c-b146-ba9f163f3030 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:59.121572 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-25f62674-bc61-4c5c-b146-ba9f163f3030 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:59.122537 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-25f62674-bc61-4c5c-b146-ba9f163f3030 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:59.123081 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-25f62674-bc61-4c5c-b146-ba9f163f3030 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:59.124162 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-25f62674-bc61-4c5c-b146-ba9f163f3030 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:59.299614 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-25f62674-bc61-4c5c-b146-ba9f163f3030 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:28:59.314532 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-25f62674-bc61-4c5c-b146-ba9f163f3030 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1314 microversion: 2.1 time: 0.206106 Sep 05 12:28:59.332644 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 420/843] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:28:59 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:00.074465 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1400f097-de82-4487-aa53-2497f187a120 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:00.075135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1400f097-de82-4487-aa53-2497f187a120 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:00.082430 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1400f097-de82-4487-aa53-2497f187a120 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:00.082911 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1400f097-de82-4487-aa53-2497f187a120 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:00.083347 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1400f097-de82-4487-aa53-2497f187a120 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:00.084082 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1400f097-de82-4487-aa53-2497f187a120 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:00.084536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1400f097-de82-4487-aa53-2497f187a120 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:00.084958 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1400f097-de82-4487-aa53-2497f187a120 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:00.243604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1400f097-de82-4487-aa53-2497f187a120 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:00.252639 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1400f097-de82-4487-aa53-2497f187a120 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:00.254120 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1400f097-de82-4487-aa53-2497f187a120 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:00.255284 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1400f097-de82-4487-aa53-2497f187a120 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1739 microversion: 2.20 time: 0.184783 Sep 05 12:29:00.255875 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 424/844] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:00 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:00.340642 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e8308e52-7093-44d5-82e1-e605f7722162 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:00.341332 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e8308e52-7093-44d5-82e1-e605f7722162 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:00.347790 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:00.349853 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e8308e52-7093-44d5-82e1-e605f7722162 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:00.350598 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e8308e52-7093-44d5-82e1-e605f7722162 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:00.351088 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e8308e52-7093-44d5-82e1-e605f7722162 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:00.352023 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e8308e52-7093-44d5-82e1-e605f7722162 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:00.352694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e8308e52-7093-44d5-82e1-e605f7722162 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:00.353318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e8308e52-7093-44d5-82e1-e605f7722162 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:00.537482 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e8308e52-7093-44d5-82e1-e605f7722162 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:00.546410 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e8308e52-7093-44d5-82e1-e605f7722162 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1314 microversion: 2.1 time: 0.209788 Sep 05 12:29:00.547630 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 421/845] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:00 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:00.613749 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-f3036586-8258-4593-ad9e-d207dd6ff013 req-cf0323f9-42c4-481e-a110-c856f054f047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48cf8078-4e41-45ba-981c-9fd3fbb15165", "name": "network-vif-plugged", "status": "completed", "tag": "f1060543-ad44-4f1a-bf19-dd96ac5985cf"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:00.624111 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-f3036586-8258-4593-ad9e-d207dd6ff013 req-cf0323f9-42c4-481e-a110-c856f054f047 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:00.624986 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-f3036586-8258-4593-ad9e-d207dd6ff013 req-cf0323f9-42c4-481e-a110-c856f054f047 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:00.625858 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-f3036586-8258-4593-ad9e-d207dd6ff013 req-cf0323f9-42c4-481e-a110-c856f054f047 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:00.642255 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-f3036586-8258-4593-ad9e-d207dd6ff013 req-cf0323f9-42c4-481e-a110-c856f054f047 service nova] Creating event network-vif-plugged:f1060543-ad44-4f1a-bf19-dd96ac5985cf for instance 48cf8078-4e41-45ba-981c-9fd3fbb15165 on hv-cinder-85518 Sep 05 12:29:00.648873 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-f3036586-8258-4593-ad9e-d207dd6ff013 req-cf0323f9-42c4-481e-a110-c856f054f047 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038332 Sep 05 12:29:00.650112 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 425/846] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:01.282245 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-19e4db7d-a534-477e-91dc-b27e896433ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:01.282857 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-19e4db7d-a534-477e-91dc-b27e896433ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:01.284800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:01.285447 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=6 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:01.292430 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-19e4db7d-a534-477e-91dc-b27e896433ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:01.293207 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-19e4db7d-a534-477e-91dc-b27e896433ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:01.293816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-19e4db7d-a534-477e-91dc-b27e896433ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:01.294552 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-19e4db7d-a534-477e-91dc-b27e896433ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:01.295016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-19e4db7d-a534-477e-91dc-b27e896433ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:01.295456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-19e4db7d-a534-477e-91dc-b27e896433ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:01.422839 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-19e4db7d-a534-477e-91dc-b27e896433ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:01.430986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-19e4db7d-a534-477e-91dc-b27e896433ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:01.432470 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-19e4db7d-a534-477e-91dc-b27e896433ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:01.433629 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-19e4db7d-a534-477e-91dc-b27e896433ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1739 microversion: 2.20 time: 0.155602 Sep 05 12:29:01.434188 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 422/847] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:01 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:01.570948 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-6121df84-bcad-4a3b-8ca8-9a99244b4e43 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:01.571682 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-6121df84-bcad-4a3b-8ca8-9a99244b4e43 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:01.573658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:01.574886 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:29:01.575023 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Mon Sep 5 12:29:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 (ip 10.222.0.16) !!! Sep 05 12:29:01.584940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6121df84-bcad-4a3b-8ca8-9a99244b4e43 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:01.585429 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6121df84-bcad-4a3b-8ca8-9a99244b4e43 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:01.585872 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6121df84-bcad-4a3b-8ca8-9a99244b4e43 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:01.586581 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6121df84-bcad-4a3b-8ca8-9a99244b4e43 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:01.587045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6121df84-bcad-4a3b-8ca8-9a99244b4e43 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:01.587477 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6121df84-bcad-4a3b-8ca8-9a99244b4e43 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:01.720549 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6121df84-bcad-4a3b-8ca8-9a99244b4e43 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:01.728153 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-6121df84-bcad-4a3b-8ca8-9a99244b4e43 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1314 microversion: 2.1 time: 0.161444 Sep 05 12:29:01.728722 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 426/848] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:01 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:02.459544 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-eae7deae-7433-47b7-a8bd-7322a81dec62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:02.460166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-eae7deae-7433-47b7-a8bd-7322a81dec62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:02.466569 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eae7deae-7433-47b7-a8bd-7322a81dec62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:02.467056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eae7deae-7433-47b7-a8bd-7322a81dec62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:02.468134 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eae7deae-7433-47b7-a8bd-7322a81dec62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:02.468824 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eae7deae-7433-47b7-a8bd-7322a81dec62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:02.469285 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eae7deae-7433-47b7-a8bd-7322a81dec62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:02.469719 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eae7deae-7433-47b7-a8bd-7322a81dec62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:02.604703 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-eae7deae-7433-47b7-a8bd-7322a81dec62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:02.612769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-eae7deae-7433-47b7-a8bd-7322a81dec62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:02.614206 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-eae7deae-7433-47b7-a8bd-7322a81dec62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:02.615355 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-eae7deae-7433-47b7-a8bd-7322a81dec62 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1739 microversion: 2.20 time: 0.159791 Sep 05 12:29:02.615944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 423/849] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:02 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:02.752038 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f9cbd82e-375a-4b95-a2da-0c7591226544 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:02.752712 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f9cbd82e-375a-4b95-a2da-0c7591226544 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:02.758863 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9cbd82e-375a-4b95-a2da-0c7591226544 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:02.759347 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9cbd82e-375a-4b95-a2da-0c7591226544 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:02.759823 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9cbd82e-375a-4b95-a2da-0c7591226544 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:02.760520 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9cbd82e-375a-4b95-a2da-0c7591226544 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:02.760978 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9cbd82e-375a-4b95-a2da-0c7591226544 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:02.761406 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f9cbd82e-375a-4b95-a2da-0c7591226544 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:02.894576 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f9cbd82e-375a-4b95-a2da-0c7591226544 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:02.905630 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f9cbd82e-375a-4b95-a2da-0c7591226544 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1498 microversion: 2.1 time: 0.158207 Sep 05 12:29:02.906280 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 427/850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:02 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:03.023147 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-cd42c8ad-c47e-4e90-b0cc-8588baf87ec1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:03.023849 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-cd42c8ad-c47e-4e90-b0cc-8588baf87ec1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:03.031167 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd42c8ad-c47e-4e90-b0cc-8588baf87ec1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:03.031696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd42c8ad-c47e-4e90-b0cc-8588baf87ec1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:03.032141 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd42c8ad-c47e-4e90-b0cc-8588baf87ec1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:03.032832 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd42c8ad-c47e-4e90-b0cc-8588baf87ec1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:03.033287 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd42c8ad-c47e-4e90-b0cc-8588baf87ec1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:03.033714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd42c8ad-c47e-4e90-b0cc-8588baf87ec1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:03.052837 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:03.062427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-cd42c8ad-c47e-4e90-b0cc-8588baf87ec1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Going to try to terminate instance {{(pid=120535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:29:03.147212 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-cd42c8ad-c47e-4e90-b0cc-8588baf87ec1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 204 len: 0 microversion: 2.1 time: 0.128128 Sep 05 12:29:03.147939 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 424/851] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:29:03 2022] DELETE /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:29:03.158755 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8c3cb8e9-39bb-47c8-bd08-ece626919b55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:03.159379 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-8c3cb8e9-39bb-47c8-bd08-ece626919b55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:03.165405 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8c3cb8e9-39bb-47c8-bd08-ece626919b55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:03.165894 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8c3cb8e9-39bb-47c8-bd08-ece626919b55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:03.166340 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8c3cb8e9-39bb-47c8-bd08-ece626919b55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:03.167039 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8c3cb8e9-39bb-47c8-bd08-ece626919b55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:03.167502 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8c3cb8e9-39bb-47c8-bd08-ece626919b55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:03.168023 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8c3cb8e9-39bb-47c8-bd08-ece626919b55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:03.345753 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8c3cb8e9-39bb-47c8-bd08-ece626919b55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:03.353473 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8c3cb8e9-39bb-47c8-bd08-ece626919b55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1576 microversion: 2.1 time: 0.201227 Sep 05 12:29:03.354290 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 428/852] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:03 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:03.468253 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7eb5ccd8-af73-4e9b-a8cd-48a27264cb8c tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:03.468835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7eb5ccd8-af73-4e9b-a8cd-48a27264cb8c tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:03.475478 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7eb5ccd8-af73-4e9b-a8cd-48a27264cb8c tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:03.475991 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7eb5ccd8-af73-4e9b-a8cd-48a27264cb8c tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:03.476451 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7eb5ccd8-af73-4e9b-a8cd-48a27264cb8c tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:03.477173 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7eb5ccd8-af73-4e9b-a8cd-48a27264cb8c tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:03.477628 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7eb5ccd8-af73-4e9b-a8cd-48a27264cb8c tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:03.478077 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7eb5ccd8-af73-4e9b-a8cd-48a27264cb8c tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:03.503426 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7eb5ccd8-af73-4e9b-a8cd-48a27264cb8c tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Going to try to terminate instance {{(pid=120535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:29:03.578882 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7eb5ccd8-af73-4e9b-a8cd-48a27264cb8c tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "DELETE /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 204 len: 0 microversion: 2.1 time: 0.115081 Sep 05 12:29:03.579373 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 425/853] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:29:03 2022] DELETE /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:29:03.587396 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c773f53a-4fb5-4e2f-baed-8094f5fa9cbf tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:03.588028 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c773f53a-4fb5-4e2f-baed-8094f5fa9cbf tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:03.594474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c773f53a-4fb5-4e2f-baed-8094f5fa9cbf tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:03.594951 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c773f53a-4fb5-4e2f-baed-8094f5fa9cbf tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:03.595388 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c773f53a-4fb5-4e2f-baed-8094f5fa9cbf tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:03.596102 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c773f53a-4fb5-4e2f-baed-8094f5fa9cbf tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:03.596548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c773f53a-4fb5-4e2f-baed-8094f5fa9cbf tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:03.596969 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c773f53a-4fb5-4e2f-baed-8094f5fa9cbf tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:03.641371 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e63c26dc-c1bb-4f74-b0db-bcecf688de9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:03.642096 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e63c26dc-c1bb-4f74-b0db-bcecf688de9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:03.648063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e63c26dc-c1bb-4f74-b0db-bcecf688de9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:03.648542 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e63c26dc-c1bb-4f74-b0db-bcecf688de9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:03.648974 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e63c26dc-c1bb-4f74-b0db-bcecf688de9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:03.649671 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e63c26dc-c1bb-4f74-b0db-bcecf688de9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:03.650107 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e63c26dc-c1bb-4f74-b0db-bcecf688de9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:03.650532 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e63c26dc-c1bb-4f74-b0db-bcecf688de9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:03.730612 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c773f53a-4fb5-4e2f-baed-8094f5fa9cbf tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:03.739405 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c773f53a-4fb5-4e2f-baed-8094f5fa9cbf tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1504 microversion: 2.1 time: 0.155719 Sep 05 12:29:03.740021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 429/854] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:03 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:03.784575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e63c26dc-c1bb-4f74-b0db-bcecf688de9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:03.792641 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e63c26dc-c1bb-4f74-b0db-bcecf688de9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:03.794074 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e63c26dc-c1bb-4f74-b0db-bcecf688de9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:03.795885 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e63c26dc-c1bb-4f74-b0db-bcecf688de9e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1721 microversion: 2.20 time: 0.158611 Sep 05 12:29:03.796445 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 426/855] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:03 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:29:04.379903 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-98aaf8ff-54ee-4266-b696-431387a8389f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:04.380512 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-98aaf8ff-54ee-4266-b696-431387a8389f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:04.386855 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98aaf8ff-54ee-4266-b696-431387a8389f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:04.387335 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98aaf8ff-54ee-4266-b696-431387a8389f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:04.387803 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98aaf8ff-54ee-4266-b696-431387a8389f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:04.388481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98aaf8ff-54ee-4266-b696-431387a8389f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:04.388997 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98aaf8ff-54ee-4266-b696-431387a8389f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:04.389916 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98aaf8ff-54ee-4266-b696-431387a8389f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:04.594363 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-98aaf8ff-54ee-4266-b696-431387a8389f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:04.602145 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-98aaf8ff-54ee-4266-b696-431387a8389f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1576 microversion: 2.1 time: 0.226046 Sep 05 12:29:04.602719 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 430/856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:04 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1576 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:04.761819 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d44cd29d-26cb-4bf5-8eee-02149f220ad0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:04.762375 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d44cd29d-26cb-4bf5-8eee-02149f220ad0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:04.769003 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d44cd29d-26cb-4bf5-8eee-02149f220ad0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:04.769482 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d44cd29d-26cb-4bf5-8eee-02149f220ad0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:04.769912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d44cd29d-26cb-4bf5-8eee-02149f220ad0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:04.770598 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d44cd29d-26cb-4bf5-8eee-02149f220ad0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:04.771046 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d44cd29d-26cb-4bf5-8eee-02149f220ad0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:04.771464 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d44cd29d-26cb-4bf5-8eee-02149f220ad0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:04.821906 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8f14ab9a-0ce3-4533-8ba9-ae89ef1d94aa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:04.822549 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-8f14ab9a-0ce3-4533-8ba9-ae89ef1d94aa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:04.828528 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8f14ab9a-0ce3-4533-8ba9-ae89ef1d94aa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:04.829010 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8f14ab9a-0ce3-4533-8ba9-ae89ef1d94aa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:04.829444 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8f14ab9a-0ce3-4533-8ba9-ae89ef1d94aa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:04.830141 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8f14ab9a-0ce3-4533-8ba9-ae89ef1d94aa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:04.830592 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8f14ab9a-0ce3-4533-8ba9-ae89ef1d94aa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:04.831016 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8f14ab9a-0ce3-4533-8ba9-ae89ef1d94aa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:04.904773 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d44cd29d-26cb-4bf5-8eee-02149f220ad0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:04.912653 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d44cd29d-26cb-4bf5-8eee-02149f220ad0 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1504 microversion: 2.1 time: 0.154773 Sep 05 12:29:04.913301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 427/857] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:04 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:04.963230 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8f14ab9a-0ce3-4533-8ba9-ae89ef1d94aa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:04.971853 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8f14ab9a-0ce3-4533-8ba9-ae89ef1d94aa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:04.973298 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8f14ab9a-0ce3-4533-8ba9-ae89ef1d94aa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:04.974466 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8f14ab9a-0ce3-4533-8ba9-ae89ef1d94aa tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1721 microversion: 2.20 time: 0.156527 Sep 05 12:29:04.974998 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 431/858] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:04 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:29:05.625952 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b1da87e5-098b-46ab-84da-de8d37b13247 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:05.626557 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b1da87e5-098b-46ab-84da-de8d37b13247 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:05.632455 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1da87e5-098b-46ab-84da-de8d37b13247 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:05.632928 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1da87e5-098b-46ab-84da-de8d37b13247 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:05.633353 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1da87e5-098b-46ab-84da-de8d37b13247 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:05.634033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1da87e5-098b-46ab-84da-de8d37b13247 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:05.634479 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1da87e5-098b-46ab-84da-de8d37b13247 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:05.634896 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1da87e5-098b-46ab-84da-de8d37b13247 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:05.767936 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b1da87e5-098b-46ab-84da-de8d37b13247 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:05.776193 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b1da87e5-098b-46ab-84da-de8d37b13247 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1576 microversion: 2.1 time: 0.154165 Sep 05 12:29:05.776763 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 428/859] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:05 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:05.936397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-bb5365b2-1ed3-4cf1-bf64-2ecf8af28ab9 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:05.936929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-bb5365b2-1ed3-4cf1-bf64-2ecf8af28ab9 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:05.943332 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb5365b2-1ed3-4cf1-bf64-2ecf8af28ab9 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:05.943841 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb5365b2-1ed3-4cf1-bf64-2ecf8af28ab9 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:05.944282 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb5365b2-1ed3-4cf1-bf64-2ecf8af28ab9 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:05.944974 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb5365b2-1ed3-4cf1-bf64-2ecf8af28ab9 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:05.945434 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb5365b2-1ed3-4cf1-bf64-2ecf8af28ab9 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:05.945868 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb5365b2-1ed3-4cf1-bf64-2ecf8af28ab9 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:05.965521 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=100 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:06.000676 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8a7e4e34-11c8-4c1a-b552-cd281137bca5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:06.001244 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8a7e4e34-11c8-4c1a-b552-cd281137bca5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:06.007156 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a7e4e34-11c8-4c1a-b552-cd281137bca5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:06.007667 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a7e4e34-11c8-4c1a-b552-cd281137bca5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:06.008104 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a7e4e34-11c8-4c1a-b552-cd281137bca5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:06.008800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a7e4e34-11c8-4c1a-b552-cd281137bca5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:06.009247 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a7e4e34-11c8-4c1a-b552-cd281137bca5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:06.009667 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a7e4e34-11c8-4c1a-b552-cd281137bca5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:06.078679 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-bb5365b2-1ed3-4cf1-bf64-2ecf8af28ab9 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:06.086388 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-bb5365b2-1ed3-4cf1-bf64-2ecf8af28ab9 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1504 microversion: 2.1 time: 0.154502 Sep 05 12:29:06.086965 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 432/860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:05 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:06.145606 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8a7e4e34-11c8-4c1a-b552-cd281137bca5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:06.154004 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8a7e4e34-11c8-4c1a-b552-cd281137bca5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:06.155514 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8a7e4e34-11c8-4c1a-b552-cd281137bca5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:06.156707 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8a7e4e34-11c8-4c1a-b552-cd281137bca5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1721 microversion: 2.20 time: 0.160599 Sep 05 12:29:06.157267 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 429/861] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:05 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:29:06.558391 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-a2e93442-cebd-442c-97d9-14877d869372 req-74259ab7-8c58-4a5a-8297-2370e4c917f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0055a73c-7732-48a3-b76b-3b8cc28e7804", "name": "network-vif-unplugged", "status": "completed", "tag": "a65b6d21-8474-43a9-bb2b-2b6a76c853f9"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:06.583272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a2e93442-cebd-442c-97d9-14877d869372 req-74259ab7-8c58-4a5a-8297-2370e4c917f8 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:06.583965 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a2e93442-cebd-442c-97d9-14877d869372 req-74259ab7-8c58-4a5a-8297-2370e4c917f8 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:06.584481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-a2e93442-cebd-442c-97d9-14877d869372 req-74259ab7-8c58-4a5a-8297-2370e4c917f8 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:06.599120 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-a2e93442-cebd-442c-97d9-14877d869372 req-74259ab7-8c58-4a5a-8297-2370e4c917f8 service nova] Creating event network-vif-unplugged:a65b6d21-8474-43a9-bb2b-2b6a76c853f9 for instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 on hv-cinder-85518 Sep 05 12:29:06.605999 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-a2e93442-cebd-442c-97d9-14877d869372 req-74259ab7-8c58-4a5a-8297-2370e4c917f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057455 Sep 05 12:29:06.607101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 433/862] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:06.800016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8ae7be82-425f-4f31-b5ce-490af1df96d2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:06.800558 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8ae7be82-425f-4f31-b5ce-490af1df96d2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:06.808546 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8ae7be82-425f-4f31-b5ce-490af1df96d2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:06.809037 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8ae7be82-425f-4f31-b5ce-490af1df96d2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:06.809476 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8ae7be82-425f-4f31-b5ce-490af1df96d2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:06.810179 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8ae7be82-425f-4f31-b5ce-490af1df96d2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:06.811131 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8ae7be82-425f-4f31-b5ce-490af1df96d2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:06.811775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8ae7be82-425f-4f31-b5ce-490af1df96d2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:07.110306 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7f7c2b32-7930-43c3-8abc-4168580522ee tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:07.110923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7f7c2b32-7930-43c3-8abc-4168580522ee tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:07.117567 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7f7c2b32-7930-43c3-8abc-4168580522ee tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:07.118055 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7f7c2b32-7930-43c3-8abc-4168580522ee tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:07.118495 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7f7c2b32-7930-43c3-8abc-4168580522ee tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:07.119197 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7f7c2b32-7930-43c3-8abc-4168580522ee tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:07.119686 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7f7c2b32-7930-43c3-8abc-4168580522ee tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:07.120118 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7f7c2b32-7930-43c3-8abc-4168580522ee tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:07.141723 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8ae7be82-425f-4f31-b5ce-490af1df96d2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:07.150537 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8ae7be82-425f-4f31-b5ce-490af1df96d2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1576 microversion: 2.1 time: 0.354574 Sep 05 12:29:07.151337 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 430/863] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:06 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1576 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:07.182806 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d2c66819-d211-4363-acd5-422d5a262b06 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:07.184056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d2c66819-d211-4363-acd5-422d5a262b06 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:07.191001 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2c66819-d211-4363-acd5-422d5a262b06 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:07.191702 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2c66819-d211-4363-acd5-422d5a262b06 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:07.192213 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2c66819-d211-4363-acd5-422d5a262b06 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:07.193685 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2c66819-d211-4363-acd5-422d5a262b06 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:07.194310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2c66819-d211-4363-acd5-422d5a262b06 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:07.194746 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d2c66819-d211-4363-acd5-422d5a262b06 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:07.273793 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7f7c2b32-7930-43c3-8abc-4168580522ee tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:07.281222 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7f7c2b32-7930-43c3-8abc-4168580522ee tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1504 microversion: 2.1 time: 0.175683 Sep 05 12:29:07.281805 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 434/864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:07 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:07.498626 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d2c66819-d211-4363-acd5-422d5a262b06 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:07.507316 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d2c66819-d211-4363-acd5-422d5a262b06 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:07.508803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d2c66819-d211-4363-acd5-422d5a262b06 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:07.509983 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d2c66819-d211-4363-acd5-422d5a262b06 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1721 microversion: 2.20 time: 0.331586 Sep 05 12:29:07.510538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 431/865] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:07 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1721 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:29:07.555311 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-81b157ae-bf89-43a9-a2b9-af56c281860a req-3e74f083-bf7c-4105-aeac-ee55e184f1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48cf8078-4e41-45ba-981c-9fd3fbb15165", "name": "network-vif-deleted", "tag": "f1060543-ad44-4f1a-bf19-dd96ac5985cf"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:07.564819 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-81b157ae-bf89-43a9-a2b9-af56c281860a req-3e74f083-bf7c-4105-aeac-ee55e184f1cf service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:07.565288 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-81b157ae-bf89-43a9-a2b9-af56c281860a req-3e74f083-bf7c-4105-aeac-ee55e184f1cf service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:07.565713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-81b157ae-bf89-43a9-a2b9-af56c281860a req-3e74f083-bf7c-4105-aeac-ee55e184f1cf service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:07.577297 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-81b157ae-bf89-43a9-a2b9-af56c281860a req-3e74f083-bf7c-4105-aeac-ee55e184f1cf service nova] Creating event network-vif-deleted:f1060543-ad44-4f1a-bf19-dd96ac5985cf for instance 48cf8078-4e41-45ba-981c-9fd3fbb15165 on hv-cinder-85518 Sep 05 12:29:07.582394 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-81b157ae-bf89-43a9-a2b9-af56c281860a req-3e74f083-bf7c-4105-aeac-ee55e184f1cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030697 Sep 05 12:29:07.582986 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 435/866] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:08.174238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4f1d35e5-343c-4b62-88d3-e8891d65d424 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:08.174856 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4f1d35e5-343c-4b62-88d3-e8891d65d424 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:08.190836 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f1d35e5-343c-4b62-88d3-e8891d65d424 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:08.191635 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f1d35e5-343c-4b62-88d3-e8891d65d424 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:08.192350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f1d35e5-343c-4b62-88d3-e8891d65d424 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:08.194684 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f1d35e5-343c-4b62-88d3-e8891d65d424 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:08.196102 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f1d35e5-343c-4b62-88d3-e8891d65d424 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:08.197374 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4f1d35e5-343c-4b62-88d3-e8891d65d424 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:08.270623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4f1d35e5-343c-4b62-88d3-e8891d65d424 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:08.281038 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4f1d35e5-343c-4b62-88d3-e8891d65d424 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1510 microversion: 2.1 time: 0.110532 Sep 05 12:29:08.281818 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 432/867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:08 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1510 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:08.306684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-6379defe-d7ad-4ac4-b579-2827292959b6 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:08.307599 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-6379defe-d7ad-4ac4-b579-2827292959b6 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:08.314483 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6379defe-d7ad-4ac4-b579-2827292959b6 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:08.314968 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6379defe-d7ad-4ac4-b579-2827292959b6 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:08.315408 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6379defe-d7ad-4ac4-b579-2827292959b6 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:08.316269 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6379defe-d7ad-4ac4-b579-2827292959b6 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:08.316762 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6379defe-d7ad-4ac4-b579-2827292959b6 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:08.317242 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6379defe-d7ad-4ac4-b579-2827292959b6 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:08.382017 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6379defe-d7ad-4ac4-b579-2827292959b6 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:08.389940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-6379defe-d7ad-4ac4-b579-2827292959b6 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1299 microversion: 2.1 time: 0.088149 Sep 05 12:29:08.390570 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 436/868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:08 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:08.538158 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-387c4287-c610-48b6-8215-37ee6ec0564c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:08.539315 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-387c4287-c610-48b6-8215-37ee6ec0564c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:08.549873 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-387c4287-c610-48b6-8215-37ee6ec0564c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:08.550912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-387c4287-c610-48b6-8215-37ee6ec0564c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:08.551377 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-387c4287-c610-48b6-8215-37ee6ec0564c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:08.552151 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-387c4287-c610-48b6-8215-37ee6ec0564c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:08.552679 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-387c4287-c610-48b6-8215-37ee6ec0564c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:08.553139 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-387c4287-c610-48b6-8215-37ee6ec0564c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:08.730520 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-387c4287-c610-48b6-8215-37ee6ec0564c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:08.741514 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-387c4287-c610-48b6-8215-37ee6ec0564c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:08.743114 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-387c4287-c610-48b6-8215-37ee6ec0564c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:08.745239 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-387c4287-c610-48b6-8215-37ee6ec0564c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1721 microversion: 2.20 time: 0.213994 Sep 05 12:29:08.746278 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 433/869] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:08 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:09.305155 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-dfba2ef1-6c13-4d07-810a-0b718fc41243 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:09.305778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-dfba2ef1-6c13-4d07-810a-0b718fc41243 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:09.312526 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dfba2ef1-6c13-4d07-810a-0b718fc41243 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:09.313096 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dfba2ef1-6c13-4d07-810a-0b718fc41243 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:09.313573 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dfba2ef1-6c13-4d07-810a-0b718fc41243 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:09.314558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dfba2ef1-6c13-4d07-810a-0b718fc41243 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:09.314856 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dfba2ef1-6c13-4d07-810a-0b718fc41243 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:09.315295 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dfba2ef1-6c13-4d07-810a-0b718fc41243 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:09.348066 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dfba2ef1-6c13-4d07-810a-0b718fc41243 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:09.348631 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dfba2ef1-6c13-4d07-810a-0b718fc41243 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:09.349079 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dfba2ef1-6c13-4d07-810a-0b718fc41243 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:09.349531 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.objects.instance [None req-dfba2ef1-6c13-4d07-810a-0b718fc41243 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lazy-loading 'fault' on Instance uuid 43404b9f-c23c-44b3-ba61-4420d1497d4f {{(pid=120534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:29:09.412702 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-dfba2ef1-6c13-4d07-810a-0b718fc41243 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:09.422682 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-af0c032d-823c-4920-8a45-2e4569b17fba tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:09.423306 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-dfba2ef1-6c13-4d07-810a-0b718fc41243 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 200 len: 1230 microversion: 2.1 time: 0.120949 Sep 05 12:29:09.424787 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 437/870] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:09 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 1230 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:09.441384 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-af0c032d-823c-4920-8a45-2e4569b17fba tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:09.448780 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af0c032d-823c-4920-8a45-2e4569b17fba tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:09.449804 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af0c032d-823c-4920-8a45-2e4569b17fba tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:09.450320 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af0c032d-823c-4920-8a45-2e4569b17fba tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:09.451801 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af0c032d-823c-4920-8a45-2e4569b17fba tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:09.452344 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af0c032d-823c-4920-8a45-2e4569b17fba tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:09.452841 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af0c032d-823c-4920-8a45-2e4569b17fba tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:09.488115 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af0c032d-823c-4920-8a45-2e4569b17fba tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:09.488594 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af0c032d-823c-4920-8a45-2e4569b17fba tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:09.489211 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af0c032d-823c-4920-8a45-2e4569b17fba tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:09.489709 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-af0c032d-823c-4920-8a45-2e4569b17fba tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lazy-loading 'fault' on Instance uuid 48cf8078-4e41-45ba-981c-9fd3fbb15165 {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:29:09.532396 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-af0c032d-823c-4920-8a45-2e4569b17fba tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad1f400be2465dbfb4a14698247496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1645a9dd82b14c25892cec9be947f310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:09.540698 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-af0c032d-823c-4920-8a45-2e4569b17fba tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 200 len: 1304 microversion: 2.1 time: 0.131204 Sep 05 12:29:09.541265 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 434/871] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:09 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:09.601240 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-7c566dff-c1d1-4872-8f78-006df5b6acdb req-c80d27a5-1d06-46ba-bed1-7d10f191ecc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43404b9f-c23c-44b3-ba61-4420d1497d4f", "name": "network-vif-deleted", "tag": "081037e4-4e81-44a8-91d2-503e4a14938d"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:09.610789 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-7c566dff-c1d1-4872-8f78-006df5b6acdb req-c80d27a5-1d06-46ba-bed1-7d10f191ecc3 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:09.611268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-7c566dff-c1d1-4872-8f78-006df5b6acdb req-c80d27a5-1d06-46ba-bed1-7d10f191ecc3 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:09.611750 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-7c566dff-c1d1-4872-8f78-006df5b6acdb req-c80d27a5-1d06-46ba-bed1-7d10f191ecc3 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:09.622359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-7c566dff-c1d1-4872-8f78-006df5b6acdb req-c80d27a5-1d06-46ba-bed1-7d10f191ecc3 service nova] Creating event network-vif-deleted:081037e4-4e81-44a8-91d2-503e4a14938d for instance 43404b9f-c23c-44b3-ba61-4420d1497d4f on hv-cinder-85518 Sep 05 12:29:09.627729 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-7c566dff-c1d1-4872-8f78-006df5b6acdb req-c80d27a5-1d06-46ba-bed1-7d10f191ecc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030082 Sep 05 12:29:09.628304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 438/872] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:09.770925 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0cfa2b57-4944-4967-855d-7fe0ee9ae97d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:09.771436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0cfa2b57-4944-4967-855d-7fe0ee9ae97d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:09.777418 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0cfa2b57-4944-4967-855d-7fe0ee9ae97d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:09.777895 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0cfa2b57-4944-4967-855d-7fe0ee9ae97d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:09.778322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0cfa2b57-4944-4967-855d-7fe0ee9ae97d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:09.779263 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0cfa2b57-4944-4967-855d-7fe0ee9ae97d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:09.779747 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0cfa2b57-4944-4967-855d-7fe0ee9ae97d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:09.780168 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0cfa2b57-4944-4967-855d-7fe0ee9ae97d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:09.912062 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0cfa2b57-4944-4967-855d-7fe0ee9ae97d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:09.921172 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0cfa2b57-4944-4967-855d-7fe0ee9ae97d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:09.922610 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0cfa2b57-4944-4967-855d-7fe0ee9ae97d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:09.923791 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0cfa2b57-4944-4967-855d-7fe0ee9ae97d tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1664 microversion: 2.20 time: 0.156817 Sep 05 12:29:09.924350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 435/873] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:09 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:09.951532 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a1e50014-cf66-4486-9634-91f53f9d5843 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b69e485-df06-4d2f-8be3-4077723b2b5f"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:09.953949 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a1e50014-cf66-4486-9634-91f53f9d5843 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:09.961023 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a1e50014-cf66-4486-9634-91f53f9d5843 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:09.961513 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a1e50014-cf66-4486-9634-91f53f9d5843 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:09.961948 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a1e50014-cf66-4486-9634-91f53f9d5843 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:09.962646 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a1e50014-cf66-4486-9634-91f53f9d5843 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:09.963095 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a1e50014-cf66-4486-9634-91f53f9d5843 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:09.963548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a1e50014-cf66-4486-9634-91f53f9d5843 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:10.234210 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a1e50014-cf66-4486-9634-91f53f9d5843 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "POST /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287035 Sep 05 12:29:10.234846 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 439/874] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Sep 5 12:29:09 2022] POST /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804/os-volume_attachments => generated 188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:29:10.358897 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-07e204ae-073d-4718-a054-b645ca09f957 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:10.359393 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-07e204ae-073d-4718-a054-b645ca09f957 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:10.365557 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-07e204ae-073d-4718-a054-b645ca09f957 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:10.366176 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-07e204ae-073d-4718-a054-b645ca09f957 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:10.366617 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-07e204ae-073d-4718-a054-b645ca09f957 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:10.367297 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-07e204ae-073d-4718-a054-b645ca09f957 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:10.367774 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-07e204ae-073d-4718-a054-b645ca09f957 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:10.368366 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-07e204ae-073d-4718-a054-b645ca09f957 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:10.447322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9ddab650-3caf-4b28-a626-d795c64f5c72 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:10.448098 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9ddab650-3caf-4b28-a626-d795c64f5c72 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:10.454591 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9ddab650-3caf-4b28-a626-d795c64f5c72 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:10.455149 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9ddab650-3caf-4b28-a626-d795c64f5c72 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:10.455537 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:10.455948 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9ddab650-3caf-4b28-a626-d795c64f5c72 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:10.456550 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9ddab650-3caf-4b28-a626-d795c64f5c72 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:10.457017 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9ddab650-3caf-4b28-a626-d795c64f5c72 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:10.457547 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9ddab650-3caf-4b28-a626-d795c64f5c72 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:10.473567 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-9ddab650-3caf-4b28-a626-d795c64f5c72 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] HTTP exception thrown: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9ddab650-3caf-4b28-a626-d795c64f5c72 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Request method failure captured: Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f HTTP/1.1 Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFerAZFsqYnyZnhqd68bLariOc-rXOkOi_rdB1cwlJU9qZpX2BFsWpEMzwXop-4f0E0zKv_r5THH5RksKaEe3kTPHDcyoDvRl8kwDAwJ5Y116h0AM82sJkpPukkrguMrZDjFnD-Ucz4skuXw8IeyKoCPkLcfYLThvXuFJUwxXrnph9nI Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 4d5cb05cfc60481fa4144ee7b077ca4f Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:29:10.475272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:29:10.477003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d5cb05cfc60481fa4144ee7b077ca4f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d5cb05cfc60481fa4144ee7b077ca4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d5cb05cfc60481fa4144ee7b077ca4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d5cb05cfc60481fa4144ee7b077ca4f"}]}] Sep 05 12:29:10.477003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:29:10.477003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 4d5cb05cfc60481fa4144ee7b077ca4f Sep 05 12:29:10.477003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:29:10.477003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-TestVolumeBootPattern-1174845777-project Sep 05 12:29:10.477003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:29:10.477003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:29:10.477003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: ebd8a00f21344c7990ffe1a7ff2986ef Sep 05 12:29:10.477003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-TestVolumeBootPattern-1174845777-project Sep 05 12:29:10.477003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:29:10.477003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:29:10.477003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '43404b9f-c23c-44b3-ba61-4420d1497d4f'} Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:29:10.478089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:29:10.479704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:10.481139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9ddab650-3caf-4b28-a626-d795c64f5c72 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Returning 404 to user: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:29:10.481139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9ddab650-3caf-4b28-a626-d795c64f5c72 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 404 len: 111 microversion: 2.1 time: 0.033269 Sep 05 12:29:10.481139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 440/875] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:10 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 12:29:10.565008 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2c564aeb-74df-4c6b-8f64-fa7c932c4364 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:10.566156 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2c564aeb-74df-4c6b-8f64-fa7c932c4364 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] [instance: 48cf8078-4e41-45ba-981c-9fd3fbb15165] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:10.576811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c564aeb-74df-4c6b-8f64-fa7c932c4364 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:10.577660 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c564aeb-74df-4c6b-8f64-fa7c932c4364 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:10.578462 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c564aeb-74df-4c6b-8f64-fa7c932c4364 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:10.579395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c564aeb-74df-4c6b-8f64-fa7c932c4364 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:10.580114 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c564aeb-74df-4c6b-8f64-fa7c932c4364 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:10.580786 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c564aeb-74df-4c6b-8f64-fa7c932c4364 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:10.598355 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-2c564aeb-74df-4c6b-8f64-fa7c932c4364 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] HTTP exception thrown: Instance 48cf8078-4e41-45ba-981c-9fd3fbb15165 could not be found. Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2c564aeb-74df-4c6b-8f64-fa7c932c4364 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Request method failure captured: Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 HTTP/1.1 Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFetuEk6QAe8RGeYQjDbPgVikojAc03CEKFxFyu696ORvrwuvfV471hXXQQzTlYTY_LUfDs9tJXIBSBmxJ0hJsxlb1YMhhspigS7RxdeCJiWDKPNSbS8Wug9qS2noaKRyNgbhxAdqxrtx27JLHTOkpzCZKWOvFwICfLhYxBkGzNtCNvY Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 1645a9dd82b14c25892cec9be947f310 Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-VolumesActionsTest-1592267262 Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:29:10.600253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:29:10.601890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1645a9dd82b14c25892cec9be947f310", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1645a9dd82b14c25892cec9be947f310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1645a9dd82b14c25892cec9be947f310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1645a9dd82b14c25892cec9be947f310"}]}] Sep 05 12:29:10.601890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-VolumesActionsTest-1592267262 Sep 05 12:29:10.601890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 1645a9dd82b14c25892cec9be947f310 Sep 05 12:29:10.601890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-VolumesActionsTest-1592267262 Sep 05 12:29:10.601890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-VolumesActionsTest-1592267262-project Sep 05 12:29:10.601890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:29:10.601890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:29:10.601890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 51ad1f400be2465dbfb4a14698247496 Sep 05 12:29:10.601890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-VolumesActionsTest-1592267262-project Sep 05 12:29:10.601890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:29:10.601890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 48cf8078-4e41-45ba-981c-9fd3fbb15165 could not be found. Sep 05 12:29:10.601890 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '48cf8078-4e41-45ba-981c-9fd3fbb15165'} Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48cf8078-4e41-45ba-981c-9fd3fbb15165 could not be found. Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:29:10.602811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48cf8078-4e41-45ba-981c-9fd3fbb15165 could not be found. Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48cf8078-4e41-45ba-981c-9fd3fbb15165 could not be found. Sep 05 12:29:10.604699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:10.606175 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2c564aeb-74df-4c6b-8f64-fa7c932c4364 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] Returning 404 to user: Instance 48cf8078-4e41-45ba-981c-9fd3fbb15165 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:29:10.606175 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2c564aeb-74df-4c6b-8f64-fa7c932c4364 tempest-VolumesActionsTest-1592267262 tempest-VolumesActionsTest-1592267262-project] 10.222.0.16 "GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165" status: 404 len: 111 microversion: 2.1 time: 0.043489 Sep 05 12:29:10.606175 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 441/876] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:10 2022] GET /compute/v2.1/servers/48cf8078-4e41-45ba-981c-9fd3fbb15165 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 12:29:10.610176 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-989739684", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-246234878", "security_groups": [{"name": "tempest-secgroup-smoke-42412145"}], "block_device_mapping_v2": [{"uuid": "ed2b76ec-bf76-4c4d-97f3-3661631afd9f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "22599f3e-588a-4fed-83e5-f9c661808b8f"}]}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:10.669568 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-07e204ae-073d-4718-a054-b645ca09f957 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804/os-volume_attachments/3b69e485-df06-4d2f-8be3-4077723b2b5f" status: 202 len: 0 microversion: 2.20 time: 0.315151 Sep 05 12:29:10.674110 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 436/877] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Sep 5 12:29:10 2022] DELETE /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804/os-volume_attachments/3b69e485-df06-4d2f-8be3-4077723b2b5f => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:29:10.744827 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f55fef48-002b-4adb-8cad-f8f8dcc042cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:10.744980 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f55fef48-002b-4adb-8cad-f8f8dcc042cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:10.747154 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.network.neutron [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] validate_networks() for [('22599f3e-588a-4fed-83e5-f9c661808b8f', None, None, None, None, None)] {{(pid=120534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:29:10.752784 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f55fef48-002b-4adb-8cad-f8f8dcc042cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:10.753277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f55fef48-002b-4adb-8cad-f8f8dcc042cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:10.753718 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f55fef48-002b-4adb-8cad-f8f8dcc042cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:10.754431 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f55fef48-002b-4adb-8cad-f8f8dcc042cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:10.754889 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f55fef48-002b-4adb-8cad-f8f8dcc042cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:10.755317 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f55fef48-002b-4adb-8cad-f8f8dcc042cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:10.792170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f55fef48-002b-4adb-8cad-f8f8dcc042cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120535) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 05 12:29:10.881823 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f55fef48-002b-4adb-8cad-f8f8dcc042cf tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "POST /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804/action" status: 202 len: 0 microversion: 2.20 time: 0.141231 Sep 05 12:29:10.882813 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 437/878] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Sep 5 12:29:10 2022] POST /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 05 12:29:10.891451 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-eddbc5a8-1d26-4d32-85bf-75ba416d33dd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:10.892124 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-eddbc5a8-1d26-4d32-85bf-75ba416d33dd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:10.898120 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eddbc5a8-1d26-4d32-85bf-75ba416d33dd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:10.898613 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eddbc5a8-1d26-4d32-85bf-75ba416d33dd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:10.899056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eddbc5a8-1d26-4d32-85bf-75ba416d33dd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:10.899961 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eddbc5a8-1d26-4d32-85bf-75ba416d33dd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:10.900422 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eddbc5a8-1d26-4d32-85bf-75ba416d33dd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:10.901226 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eddbc5a8-1d26-4d32-85bf-75ba416d33dd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:11.075670 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-eddbc5a8-1d26-4d32-85bf-75ba416d33dd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:11.091623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-eddbc5a8-1d26-4d32-85bf-75ba416d33dd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:11.093107 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-eddbc5a8-1d26-4d32-85bf-75ba416d33dd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:11.094295 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-eddbc5a8-1d26-4d32-85bf-75ba416d33dd tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1672 microversion: 2.20 time: 0.207408 Sep 05 12:29:11.100536 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 438/879] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:10 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1672 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:11.197554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Flavor limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:29:11.197988 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Image limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:29:11.198468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Flavor pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:29:11.198881 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Image pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:29:11.199283 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:29:11.211491 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:11.212382 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:11.212840 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:11.213740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:11.214119 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:11.214550 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:11.232057 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Getting quotas for project 4d5cb05cfc60481fa4144ee7b077ca4f. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:29:11.236907 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Getting quotas for user ebd8a00f21344c7990ffe1a7ff2986ef and project 4d5cb05cfc60481fa4144ee7b077ca4f. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:29:11.312014 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Going to run 1 instances... {{(pid=120534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:29:11.314219 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed2b76ec-bf76-4c4d-97f3-3661631afd9f',volume_size=None,volume_type=None)] {{(pid=120534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:29:11.464686 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-6ab365c4-71b6-4cbc-9122-c6e2fbc43675 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.858600 Sep 05 12:29:11.466054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 442/880] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:29:10 2022] POST /compute/v2.1/servers => generated 404 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:29:11.478770 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5501f20c-f0b9-43f1-b005-6900b9a03c06 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:11.479390 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5501f20c-f0b9-43f1-b005-6900b9a03c06 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:11.545443 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5501f20c-f0b9-43f1-b005-6900b9a03c06 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:11.552758 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5501f20c-f0b9-43f1-b005-6900b9a03c06 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1093 microversion: 2.1 time: 0.078196 Sep 05 12:29:11.553327 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 439/881] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:11 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:12.119928 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-957c498b-84e6-44da-876d-265840c35a9a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:12.120454 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-957c498b-84e6-44da-876d-265840c35a9a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:12.127216 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-957c498b-84e6-44da-876d-265840c35a9a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:12.127739 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-957c498b-84e6-44da-876d-265840c35a9a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:12.128187 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-957c498b-84e6-44da-876d-265840c35a9a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:12.128881 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-957c498b-84e6-44da-876d-265840c35a9a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:12.129338 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-957c498b-84e6-44da-876d-265840c35a9a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:12.129769 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-957c498b-84e6-44da-876d-265840c35a9a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:12.276072 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-957c498b-84e6-44da-876d-265840c35a9a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:12.284395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-957c498b-84e6-44da-876d-265840c35a9a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:12.285835 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-957c498b-84e6-44da-876d-265840c35a9a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:12.286981 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-957c498b-84e6-44da-876d-265840c35a9a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1674 microversion: 2.20 time: 0.171185 Sep 05 12:29:12.287553 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 443/882] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:12 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:12.576180 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5af1b2fc-8c99-462c-8f3d-0e04504a40a1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:12.576788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5af1b2fc-8c99-462c-8f3d-0e04504a40a1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:12.583908 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5af1b2fc-8c99-462c-8f3d-0e04504a40a1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:12.584375 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5af1b2fc-8c99-462c-8f3d-0e04504a40a1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:12.584807 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5af1b2fc-8c99-462c-8f3d-0e04504a40a1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:12.585489 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5af1b2fc-8c99-462c-8f3d-0e04504a40a1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:12.585943 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5af1b2fc-8c99-462c-8f3d-0e04504a40a1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:12.586368 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5af1b2fc-8c99-462c-8f3d-0e04504a40a1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:12.647654 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5af1b2fc-8c99-462c-8f3d-0e04504a40a1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:12.656061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5af1b2fc-8c99-462c-8f3d-0e04504a40a1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1135 microversion: 2.1 time: 0.083735 Sep 05 12:29:12.656625 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 440/883] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:12 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1135 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:13.313360 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-dc4d92db-c6a0-4441-85a1-d71283135f57 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:13.313971 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-dc4d92db-c6a0-4441-85a1-d71283135f57 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:13.320502 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dc4d92db-c6a0-4441-85a1-d71283135f57 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:13.320981 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dc4d92db-c6a0-4441-85a1-d71283135f57 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:13.321416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dc4d92db-c6a0-4441-85a1-d71283135f57 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:13.322103 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dc4d92db-c6a0-4441-85a1-d71283135f57 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:13.322555 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dc4d92db-c6a0-4441-85a1-d71283135f57 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:13.322980 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-dc4d92db-c6a0-4441-85a1-d71283135f57 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:13.453224 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-dc4d92db-c6a0-4441-85a1-d71283135f57 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:13.461282 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-dc4d92db-c6a0-4441-85a1-d71283135f57 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:13.462729 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-dc4d92db-c6a0-4441-85a1-d71283135f57 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:13.463907 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-dc4d92db-c6a0-4441-85a1-d71283135f57 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1674 microversion: 2.20 time: 0.154960 Sep 05 12:29:13.464466 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 444/884] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:13 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:13.679769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-dc000eed-e829-4981-b0b5-171896becd55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:13.680316 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-dc000eed-e829-4981-b0b5-171896becd55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:13.687442 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc000eed-e829-4981-b0b5-171896becd55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:13.687994 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc000eed-e829-4981-b0b5-171896becd55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:13.688430 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc000eed-e829-4981-b0b5-171896becd55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:13.689119 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc000eed-e829-4981-b0b5-171896becd55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:13.689575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc000eed-e829-4981-b0b5-171896becd55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:13.689994 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc000eed-e829-4981-b0b5-171896becd55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:13.751200 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-dc000eed-e829-4981-b0b5-171896becd55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:13.758872 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-dc000eed-e829-4981-b0b5-171896becd55 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1135 microversion: 2.1 time: 0.083117 Sep 05 12:29:13.759440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 441/885] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:13 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1135 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:14.489176 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c1c97bc2-76fc-4781-b7f3-d39c67da51ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:14.489762 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c1c97bc2-76fc-4781-b7f3-d39c67da51ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:14.496257 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c1c97bc2-76fc-4781-b7f3-d39c67da51ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:14.496744 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c1c97bc2-76fc-4781-b7f3-d39c67da51ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:14.497182 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c1c97bc2-76fc-4781-b7f3-d39c67da51ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:14.498538 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c1c97bc2-76fc-4781-b7f3-d39c67da51ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:14.499000 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c1c97bc2-76fc-4781-b7f3-d39c67da51ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:14.499429 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c1c97bc2-76fc-4781-b7f3-d39c67da51ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:14.627261 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c1c97bc2-76fc-4781-b7f3-d39c67da51ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:14.635338 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c1c97bc2-76fc-4781-b7f3-d39c67da51ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:14.636895 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c1c97bc2-76fc-4781-b7f3-d39c67da51ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:14.638044 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c1c97bc2-76fc-4781-b7f3-d39c67da51ff tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1674 microversion: 2.20 time: 0.152882 Sep 05 12:29:14.638606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 445/886] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:14 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:14.782190 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5238c58c-9a5c-4cb6-9432-8bce2aa617a8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:14.782946 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5238c58c-9a5c-4cb6-9432-8bce2aa617a8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:14.789140 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5238c58c-9a5c-4cb6-9432-8bce2aa617a8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:14.789627 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5238c58c-9a5c-4cb6-9432-8bce2aa617a8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:14.790063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5238c58c-9a5c-4cb6-9432-8bce2aa617a8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:14.790749 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5238c58c-9a5c-4cb6-9432-8bce2aa617a8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:14.791206 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5238c58c-9a5c-4cb6-9432-8bce2aa617a8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:14.791665 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5238c58c-9a5c-4cb6-9432-8bce2aa617a8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:14.854311 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5238c58c-9a5c-4cb6-9432-8bce2aa617a8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:14.862655 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5238c58c-9a5c-4cb6-9432-8bce2aa617a8 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1135 microversion: 2.1 time: 0.085145 Sep 05 12:29:14.863224 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 442/887] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:14 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1135 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:15.662798 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9bc7dd66-c077-4364-96a9-ffd753e911c8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:15.663413 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9bc7dd66-c077-4364-96a9-ffd753e911c8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:15.671458 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9bc7dd66-c077-4364-96a9-ffd753e911c8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:15.671974 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9bc7dd66-c077-4364-96a9-ffd753e911c8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:15.672599 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9bc7dd66-c077-4364-96a9-ffd753e911c8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:15.673311 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9bc7dd66-c077-4364-96a9-ffd753e911c8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:15.673835 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9bc7dd66-c077-4364-96a9-ffd753e911c8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:15.674616 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9bc7dd66-c077-4364-96a9-ffd753e911c8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:15.834977 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9bc7dd66-c077-4364-96a9-ffd753e911c8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:15.843304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9bc7dd66-c077-4364-96a9-ffd753e911c8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:15.844784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9bc7dd66-c077-4364-96a9-ffd753e911c8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:15.845941 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9bc7dd66-c077-4364-96a9-ffd753e911c8 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.187067 Sep 05 12:29:15.846494 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 446/888] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:15 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:15.885376 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-97781777-7326-4f1d-b6c7-29b8bde5879b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:15.885983 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-97781777-7326-4f1d-b6c7-29b8bde5879b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:15.892609 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97781777-7326-4f1d-b6c7-29b8bde5879b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:15.893081 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97781777-7326-4f1d-b6c7-29b8bde5879b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:15.893509 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97781777-7326-4f1d-b6c7-29b8bde5879b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:15.894183 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97781777-7326-4f1d-b6c7-29b8bde5879b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:15.894644 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97781777-7326-4f1d-b6c7-29b8bde5879b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:15.895041 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-97781777-7326-4f1d-b6c7-29b8bde5879b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:15.956323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-97781777-7326-4f1d-b6c7-29b8bde5879b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:15.963799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-97781777-7326-4f1d-b6c7-29b8bde5879b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1191 microversion: 2.1 time: 0.082318 Sep 05 12:29:15.964365 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 443/889] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:15 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:16.872605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-6f0d7230-b635-4f3d-82b3-641aa962f484 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:16.873385 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-6f0d7230-b635-4f3d-82b3-641aa962f484 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:16.879952 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6f0d7230-b635-4f3d-82b3-641aa962f484 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:16.880445 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6f0d7230-b635-4f3d-82b3-641aa962f484 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:16.880901 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6f0d7230-b635-4f3d-82b3-641aa962f484 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:16.881610 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6f0d7230-b635-4f3d-82b3-641aa962f484 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:16.882067 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6f0d7230-b635-4f3d-82b3-641aa962f484 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:16.882494 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6f0d7230-b635-4f3d-82b3-641aa962f484 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:16.986963 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-eba54300-8fed-4734-b477-fad9e6fd2fea tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:16.987614 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-eba54300-8fed-4734-b477-fad9e6fd2fea tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:16.994306 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eba54300-8fed-4734-b477-fad9e6fd2fea tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:16.994788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eba54300-8fed-4734-b477-fad9e6fd2fea tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:16.995216 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eba54300-8fed-4734-b477-fad9e6fd2fea tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:16.995974 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eba54300-8fed-4734-b477-fad9e6fd2fea tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:16.996422 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eba54300-8fed-4734-b477-fad9e6fd2fea tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:16.996846 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eba54300-8fed-4734-b477-fad9e6fd2fea tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:17.018579 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6f0d7230-b635-4f3d-82b3-641aa962f484 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:17.029401 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6f0d7230-b635-4f3d-82b3-641aa962f484 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:17.031748 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6f0d7230-b635-4f3d-82b3-641aa962f484 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:17.033277 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-6f0d7230-b635-4f3d-82b3-641aa962f484 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.164616 Sep 05 12:29:17.034381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 447/890] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:16 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:29:17.109743 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-eba54300-8fed-4734-b477-fad9e6fd2fea tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:17.117924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-eba54300-8fed-4734-b477-fad9e6fd2fea tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1209 microversion: 2.1 time: 0.135388 Sep 05 12:29:17.118503 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 444/891] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:16 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1209 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:18.073439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a576c1ae-0f5d-4ffe-a50c-d706579ad998 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:18.079164 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a576c1ae-0f5d-4ffe-a50c-d706579ad998 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:18.100393 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a576c1ae-0f5d-4ffe-a50c-d706579ad998 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:18.101322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a576c1ae-0f5d-4ffe-a50c-d706579ad998 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:18.102575 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a576c1ae-0f5d-4ffe-a50c-d706579ad998 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:18.103563 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a576c1ae-0f5d-4ffe-a50c-d706579ad998 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:18.104244 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a576c1ae-0f5d-4ffe-a50c-d706579ad998 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:18.105557 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a576c1ae-0f5d-4ffe-a50c-d706579ad998 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:18.149087 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1febf26b-78fe-4ce7-b945-91c4a7d4e661 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:18.149808 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-1febf26b-78fe-4ce7-b945-91c4a7d4e661 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:18.162146 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1febf26b-78fe-4ce7-b945-91c4a7d4e661 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:18.162968 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1febf26b-78fe-4ce7-b945-91c4a7d4e661 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:18.163624 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1febf26b-78fe-4ce7-b945-91c4a7d4e661 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:18.164576 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1febf26b-78fe-4ce7-b945-91c4a7d4e661 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:18.166299 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1febf26b-78fe-4ce7-b945-91c4a7d4e661 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:18.168780 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1febf26b-78fe-4ce7-b945-91c4a7d4e661 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:18.413399 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a576c1ae-0f5d-4ffe-a50c-d706579ad998 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:18.426889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a576c1ae-0f5d-4ffe-a50c-d706579ad998 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:18.435034 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a576c1ae-0f5d-4ffe-a50c-d706579ad998 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:18.437157 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a576c1ae-0f5d-4ffe-a50c-d706579ad998 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.380684 Sep 05 12:29:18.463196 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 448/892] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:18 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:18.642293 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1febf26b-78fe-4ce7-b945-91c4a7d4e661 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:18.659997 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1febf26b-78fe-4ce7-b945-91c4a7d4e661 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.514945 Sep 05 12:29:18.662407 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 445/893] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:18 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:19.208089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-e065f6ef-5a96-4950-8787-243bab1c2775 req-3eff957c-2ab8-413c-9d93-556218905661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11d5a4f8-842e-423f-9974-d6d49a1b3bbb", "tag": "23399c5d-28fe-401d-861b-d0a48db49404"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:19.226191 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-e065f6ef-5a96-4950-8787-243bab1c2775 req-3eff957c-2ab8-413c-9d93-556218905661 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:19.230211 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-e065f6ef-5a96-4950-8787-243bab1c2775 req-3eff957c-2ab8-413c-9d93-556218905661 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:19.231695 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-e065f6ef-5a96-4950-8787-243bab1c2775 req-3eff957c-2ab8-413c-9d93-556218905661 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:19.260932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-e065f6ef-5a96-4950-8787-243bab1c2775 req-3eff957c-2ab8-413c-9d93-556218905661 service nova] Creating event network-changed:23399c5d-28fe-401d-861b-d0a48db49404 for instance 11d5a4f8-842e-423f-9974-d6d49a1b3bbb on hv-cinder-85518 Sep 05 12:29:19.272306 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-e065f6ef-5a96-4950-8787-243bab1c2775 req-3eff957c-2ab8-413c-9d93-556218905661 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067724 Sep 05 12:29:19.273214 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 449/894] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:19.476472 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-238c4695-3d98-40b1-a335-ecf991def3c6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:19.477993 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-238c4695-3d98-40b1-a335-ecf991def3c6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:19.497368 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-238c4695-3d98-40b1-a335-ecf991def3c6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:19.499420 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-238c4695-3d98-40b1-a335-ecf991def3c6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:19.504281 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-238c4695-3d98-40b1-a335-ecf991def3c6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:19.505510 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-238c4695-3d98-40b1-a335-ecf991def3c6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:19.506144 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-238c4695-3d98-40b1-a335-ecf991def3c6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:19.506730 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-238c4695-3d98-40b1-a335-ecf991def3c6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:19.693058 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8318a2a2-79a3-4359-b89c-3384507bab48 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:19.694213 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-8318a2a2-79a3-4359-b89c-3384507bab48 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:19.712105 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8318a2a2-79a3-4359-b89c-3384507bab48 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:19.714837 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8318a2a2-79a3-4359-b89c-3384507bab48 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:19.715456 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8318a2a2-79a3-4359-b89c-3384507bab48 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:19.716392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8318a2a2-79a3-4359-b89c-3384507bab48 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:19.725301 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8318a2a2-79a3-4359-b89c-3384507bab48 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:19.726040 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8318a2a2-79a3-4359-b89c-3384507bab48 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:19.778807 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-238c4695-3d98-40b1-a335-ecf991def3c6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:19.788413 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-238c4695-3d98-40b1-a335-ecf991def3c6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:19.789863 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-238c4695-3d98-40b1-a335-ecf991def3c6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:19.791046 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-238c4695-3d98-40b1-a335-ecf991def3c6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.325214 Sep 05 12:29:19.791618 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 446/895] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:19 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:19.994709 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8318a2a2-79a3-4359-b89c-3384507bab48 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:20.002658 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:20.014799 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8318a2a2-79a3-4359-b89c-3384507bab48 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.326179 Sep 05 12:29:20.037462 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 450/896] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:19 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:20.817005 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-20245ffd-2b3e-4d68-a6ba-149fb51b4118 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:20.817750 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-20245ffd-2b3e-4d68-a6ba-149fb51b4118 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:20.825122 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-20245ffd-2b3e-4d68-a6ba-149fb51b4118 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:20.825995 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-20245ffd-2b3e-4d68-a6ba-149fb51b4118 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:20.827017 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-20245ffd-2b3e-4d68-a6ba-149fb51b4118 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:20.828064 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-20245ffd-2b3e-4d68-a6ba-149fb51b4118 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:20.829194 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-20245ffd-2b3e-4d68-a6ba-149fb51b4118 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:20.838202 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-20245ffd-2b3e-4d68-a6ba-149fb51b4118 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:21.021654 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-20245ffd-2b3e-4d68-a6ba-149fb51b4118 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:21.034294 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-20245ffd-2b3e-4d68-a6ba-149fb51b4118 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:21.036171 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-20245ffd-2b3e-4d68-a6ba-149fb51b4118 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:21.040376 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-20245ffd-2b3e-4d68-a6ba-149fb51b4118 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.227252 Sep 05 12:29:21.042705 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 447/897] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:20 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:21.069187 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e00b067b-7b3c-4f82-89bf-176126a9d287 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:21.069904 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e00b067b-7b3c-4f82-89bf-176126a9d287 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:21.089921 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e00b067b-7b3c-4f82-89bf-176126a9d287 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:21.093310 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e00b067b-7b3c-4f82-89bf-176126a9d287 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:21.096075 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e00b067b-7b3c-4f82-89bf-176126a9d287 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:21.097039 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e00b067b-7b3c-4f82-89bf-176126a9d287 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:21.099843 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e00b067b-7b3c-4f82-89bf-176126a9d287 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:21.100460 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e00b067b-7b3c-4f82-89bf-176126a9d287 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:21.302577 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:21.303590 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=6 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:21.493174 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e00b067b-7b3c-4f82-89bf-176126a9d287 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:21.505649 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e00b067b-7b3c-4f82-89bf-176126a9d287 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.467244 Sep 05 12:29:21.509726 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 451/898] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:21 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:22.080783 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ec769c08-42d2-4f91-b4a5-2e386cc3b89c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:22.082201 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ec769c08-42d2-4f91-b4a5-2e386cc3b89c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:22.089968 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:22.093547 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ec769c08-42d2-4f91-b4a5-2e386cc3b89c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:22.094298 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ec769c08-42d2-4f91-b4a5-2e386cc3b89c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:22.095003 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ec769c08-42d2-4f91-b4a5-2e386cc3b89c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:22.095973 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ec769c08-42d2-4f91-b4a5-2e386cc3b89c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:22.096639 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ec769c08-42d2-4f91-b4a5-2e386cc3b89c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:22.097270 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ec769c08-42d2-4f91-b4a5-2e386cc3b89c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:22.431758 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ec769c08-42d2-4f91-b4a5-2e386cc3b89c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:22.443240 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ec769c08-42d2-4f91-b4a5-2e386cc3b89c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:22.444986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ec769c08-42d2-4f91-b4a5-2e386cc3b89c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:22.446314 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ec769c08-42d2-4f91-b4a5-2e386cc3b89c tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.370101 Sep 05 12:29:22.447497 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 448/899] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:22 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:22.540254 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f6000838-9679-4b67-a247-4a456dc9d3f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:22.541986 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f6000838-9679-4b67-a247-4a456dc9d3f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:22.560299 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6000838-9679-4b67-a247-4a456dc9d3f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:22.562751 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6000838-9679-4b67-a247-4a456dc9d3f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:22.564389 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6000838-9679-4b67-a247-4a456dc9d3f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:22.565689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6000838-9679-4b67-a247-4a456dc9d3f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:22.566605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6000838-9679-4b67-a247-4a456dc9d3f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:22.567590 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f6000838-9679-4b67-a247-4a456dc9d3f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:22.782934 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f6000838-9679-4b67-a247-4a456dc9d3f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:22.797770 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f6000838-9679-4b67-a247-4a456dc9d3f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.263713 Sep 05 12:29:22.798536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 452/900] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:22 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:23.480865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-cdd3a47e-9ed2-4439-97dd-4725cf140bf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:23.483413 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-cdd3a47e-9ed2-4439-97dd-4725cf140bf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:23.513973 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cdd3a47e-9ed2-4439-97dd-4725cf140bf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:23.514478 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cdd3a47e-9ed2-4439-97dd-4725cf140bf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:23.515213 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cdd3a47e-9ed2-4439-97dd-4725cf140bf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:23.515979 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cdd3a47e-9ed2-4439-97dd-4725cf140bf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:23.516440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cdd3a47e-9ed2-4439-97dd-4725cf140bf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:23.516868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cdd3a47e-9ed2-4439-97dd-4725cf140bf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:23.754582 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-cdd3a47e-9ed2-4439-97dd-4725cf140bf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:23.763601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-cdd3a47e-9ed2-4439-97dd-4725cf140bf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:23.765080 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-cdd3a47e-9ed2-4439-97dd-4725cf140bf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:23.766456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-cdd3a47e-9ed2-4439-97dd-4725cf140bf9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.294224 Sep 05 12:29:23.767535 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 449/901] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:23 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:23.827265 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0f0f2ef8-c492-4966-b8c5-ce61c3484d80 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:23.828108 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0f0f2ef8-c492-4966-b8c5-ce61c3484d80 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:23.836356 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0f0f2ef8-c492-4966-b8c5-ce61c3484d80 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:23.837363 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0f0f2ef8-c492-4966-b8c5-ce61c3484d80 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:23.837363 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0f0f2ef8-c492-4966-b8c5-ce61c3484d80 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:23.837940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0f0f2ef8-c492-4966-b8c5-ce61c3484d80 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:23.838393 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0f0f2ef8-c492-4966-b8c5-ce61c3484d80 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:23.838814 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0f0f2ef8-c492-4966-b8c5-ce61c3484d80 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:24.077238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-0f0f2ef8-c492-4966-b8c5-ce61c3484d80 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:24.094639 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0f0f2ef8-c492-4966-b8c5-ce61c3484d80 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.271797 Sep 05 12:29:24.097295 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 453/902] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:23 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:24.793049 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-43f418e4-c48f-43d9-a52f-6b56306e5fba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:24.793658 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-43f418e4-c48f-43d9-a52f-6b56306e5fba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:24.806465 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-43f418e4-c48f-43d9-a52f-6b56306e5fba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:24.808013 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-43f418e4-c48f-43d9-a52f-6b56306e5fba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:24.813207 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-43f418e4-c48f-43d9-a52f-6b56306e5fba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:24.814208 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-43f418e4-c48f-43d9-a52f-6b56306e5fba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:24.814847 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-43f418e4-c48f-43d9-a52f-6b56306e5fba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:24.815274 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-43f418e4-c48f-43d9-a52f-6b56306e5fba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:24.974683 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-43f418e4-c48f-43d9-a52f-6b56306e5fba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:24.988221 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-43f418e4-c48f-43d9-a52f-6b56306e5fba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:24.990404 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-43f418e4-c48f-43d9-a52f-6b56306e5fba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:24.992202 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-43f418e4-c48f-43d9-a52f-6b56306e5fba tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.202831 Sep 05 12:29:24.993074 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 450/903] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:24 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:25.137318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-6c066d0c-6506-4d06-ae40-de058f1f0747 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:25.138877 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-6c066d0c-6506-4d06-ae40-de058f1f0747 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:25.157284 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6c066d0c-6506-4d06-ae40-de058f1f0747 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:25.164851 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6c066d0c-6506-4d06-ae40-de058f1f0747 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:25.168577 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6c066d0c-6506-4d06-ae40-de058f1f0747 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:25.172721 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6c066d0c-6506-4d06-ae40-de058f1f0747 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:25.187000 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6c066d0c-6506-4d06-ae40-de058f1f0747 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:25.187723 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6c066d0c-6506-4d06-ae40-de058f1f0747 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:25.437565 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6c066d0c-6506-4d06-ae40-de058f1f0747 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:25.450803 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-6c066d0c-6506-4d06-ae40-de058f1f0747 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.316919 Sep 05 12:29:25.452026 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 454/904] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:25 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:26.020650 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b865096d-279d-4042-b214-f5064d4f6f30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:26.022139 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b865096d-279d-4042-b214-f5064d4f6f30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:26.031748 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b865096d-279d-4042-b214-f5064d4f6f30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:26.036551 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b865096d-279d-4042-b214-f5064d4f6f30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:26.037343 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b865096d-279d-4042-b214-f5064d4f6f30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:26.038458 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b865096d-279d-4042-b214-f5064d4f6f30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:26.039215 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b865096d-279d-4042-b214-f5064d4f6f30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:26.040100 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b865096d-279d-4042-b214-f5064d4f6f30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:26.048326 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d41dcdf8-8139-427e-80ce-bfa75aa90730 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:26.049253 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d41dcdf8-8139-427e-80ce-bfa75aa90730 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:26.060416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d41dcdf8-8139-427e-80ce-bfa75aa90730 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:26.061437 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d41dcdf8-8139-427e-80ce-bfa75aa90730 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:26.062104 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d41dcdf8-8139-427e-80ce-bfa75aa90730 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:26.063058 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d41dcdf8-8139-427e-80ce-bfa75aa90730 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:26.073987 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d41dcdf8-8139-427e-80ce-bfa75aa90730 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:26.075015 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d41dcdf8-8139-427e-80ce-bfa75aa90730 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:26.118201 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d41dcdf8-8139-427e-80ce-bfa75aa90730 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/ips" status: 200 len: 145 microversion: 2.1 time: 0.074222 Sep 05 12:29:26.124217 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 455/905] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Sep 5 12:29:26 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/ips => generated 145 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:29:26.352747 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b865096d-279d-4042-b214-f5064d4f6f30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:26.356036 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:26.379642 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b865096d-279d-4042-b214-f5064d4f6f30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:26.381259 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b865096d-279d-4042-b214-f5064d4f6f30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:26.388171 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b865096d-279d-4042-b214-f5064d4f6f30 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.371845 Sep 05 12:29:26.388962 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 451/906] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:26 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:26.488950 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5c602f21-f367-4848-a850-2ddc5caf53b9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:26.494056 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5c602f21-f367-4848-a850-2ddc5caf53b9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:26.527721 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5c602f21-f367-4848-a850-2ddc5caf53b9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:26.530143 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5c602f21-f367-4848-a850-2ddc5caf53b9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:26.530720 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5c602f21-f367-4848-a850-2ddc5caf53b9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:26.532354 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5c602f21-f367-4848-a850-2ddc5caf53b9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:26.534755 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5c602f21-f367-4848-a850-2ddc5caf53b9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:26.536397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5c602f21-f367-4848-a850-2ddc5caf53b9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:26.867392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5c602f21-f367-4848-a850-2ddc5caf53b9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:26.875581 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5c602f21-f367-4848-a850-2ddc5caf53b9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.404404 Sep 05 12:29:26.877155 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 456/907] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:26 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:27.419919 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ab2092e3-b8d9-415d-a5cb-3819aedb396f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:27.421191 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ab2092e3-b8d9-415d-a5cb-3819aedb396f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:27.429387 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ab2092e3-b8d9-415d-a5cb-3819aedb396f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:27.430226 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ab2092e3-b8d9-415d-a5cb-3819aedb396f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:27.430684 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ab2092e3-b8d9-415d-a5cb-3819aedb396f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:27.431742 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ab2092e3-b8d9-415d-a5cb-3819aedb396f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:27.432440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ab2092e3-b8d9-415d-a5cb-3819aedb396f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:27.433139 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ab2092e3-b8d9-415d-a5cb-3819aedb396f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:27.587792 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ab2092e3-b8d9-415d-a5cb-3819aedb396f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:27.597212 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ab2092e3-b8d9-415d-a5cb-3819aedb396f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:27.600062 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ab2092e3-b8d9-415d-a5cb-3819aedb396f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:27.602167 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ab2092e3-b8d9-415d-a5cb-3819aedb396f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.187783 Sep 05 12:29:27.615552 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 452/908] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:27 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:27.904987 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-efcd515f-2926-4ab9-9bb2-0c730fb09d76 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:27.906521 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-efcd515f-2926-4ab9-9bb2-0c730fb09d76 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:27.909301 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:27.917366 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-efcd515f-2926-4ab9-9bb2-0c730fb09d76 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:27.919003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-efcd515f-2926-4ab9-9bb2-0c730fb09d76 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:27.920012 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-efcd515f-2926-4ab9-9bb2-0c730fb09d76 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:27.921839 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-efcd515f-2926-4ab9-9bb2-0c730fb09d76 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:27.922724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-efcd515f-2926-4ab9-9bb2-0c730fb09d76 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:27.923952 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-efcd515f-2926-4ab9-9bb2-0c730fb09d76 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:28.087207 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-efcd515f-2926-4ab9-9bb2-0c730fb09d76 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:28.098947 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-efcd515f-2926-4ab9-9bb2-0c730fb09d76 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.200219 Sep 05 12:29:28.100358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 457/909] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:27 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:28.629663 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ccacd645-60ec-48df-a955-e86f2bd83d2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:28.631029 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ccacd645-60ec-48df-a955-e86f2bd83d2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:28.638648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ccacd645-60ec-48df-a955-e86f2bd83d2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:28.639555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ccacd645-60ec-48df-a955-e86f2bd83d2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:28.640234 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ccacd645-60ec-48df-a955-e86f2bd83d2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:28.641163 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ccacd645-60ec-48df-a955-e86f2bd83d2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:28.641858 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ccacd645-60ec-48df-a955-e86f2bd83d2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:28.642519 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ccacd645-60ec-48df-a955-e86f2bd83d2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:28.862583 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5242fe1c-6406-4b43-9cf2-e68cbffd3290 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e512bab-1999-4a9a-8666-232313a85370"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:28.877055 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5242fe1c-6406-4b43-9cf2-e68cbffd3290 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:28.883464 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5242fe1c-6406-4b43-9cf2-e68cbffd3290 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:28.884004 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5242fe1c-6406-4b43-9cf2-e68cbffd3290 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:28.885610 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5242fe1c-6406-4b43-9cf2-e68cbffd3290 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:28.886354 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5242fe1c-6406-4b43-9cf2-e68cbffd3290 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:28.886809 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5242fe1c-6406-4b43-9cf2-e68cbffd3290 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:28.887238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5242fe1c-6406-4b43-9cf2-e68cbffd3290 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:29.133474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ccacd645-60ec-48df-a955-e86f2bd83d2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:29.142026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ccacd645-60ec-48df-a955-e86f2bd83d2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:29.143466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ccacd645-60ec-48df-a955-e86f2bd83d2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:29.148679 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ccacd645-60ec-48df-a955-e86f2bd83d2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.522919 Sep 05 12:29:29.152555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 453/910] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:28 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:29.160395 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-dc39879c-abf0-4407-9fd3-d64801664982 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:29.162128 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-dc39879c-abf0-4407-9fd3-d64801664982 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:29.171200 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc39879c-abf0-4407-9fd3-d64801664982 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:29.172109 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc39879c-abf0-4407-9fd3-d64801664982 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:29.172787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc39879c-abf0-4407-9fd3-d64801664982 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:29.173858 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc39879c-abf0-4407-9fd3-d64801664982 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:29.174399 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc39879c-abf0-4407-9fd3-d64801664982 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:29.174902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dc39879c-abf0-4407-9fd3-d64801664982 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:29.362627 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-dc39879c-abf0-4407-9fd3-d64801664982 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:29.377472 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-dc39879c-abf0-4407-9fd3-d64801664982 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.218298 Sep 05 12:29:29.407744 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 454/911] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:29 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:29.444837 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-acd48773-8ef2-40c2-89e7-f4cffed939a0 req-fbb95bc6-3475-4b98-8774-3e8b728199f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4181d872-fbd4-4b16-b8c2-d086dd1253b2", "tag": "935d1954-274e-487a-b68a-696df548ac2a"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:29.456686 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-acd48773-8ef2-40c2-89e7-f4cffed939a0 req-fbb95bc6-3475-4b98-8774-3e8b728199f3 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:29.457332 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-acd48773-8ef2-40c2-89e7-f4cffed939a0 req-fbb95bc6-3475-4b98-8774-3e8b728199f3 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:29.457855 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-acd48773-8ef2-40c2-89e7-f4cffed939a0 req-fbb95bc6-3475-4b98-8774-3e8b728199f3 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:29.470582 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-acd48773-8ef2-40c2-89e7-f4cffed939a0 req-fbb95bc6-3475-4b98-8774-3e8b728199f3 service nova] Creating event network-changed:935d1954-274e-487a-b68a-696df548ac2a for instance 4181d872-fbd4-4b16-b8c2-d086dd1253b2 on hv-cinder-85518 Sep 05 12:29:29.476493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-acd48773-8ef2-40c2-89e7-f4cffed939a0 req-fbb95bc6-3475-4b98-8774-3e8b728199f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035100 Sep 05 12:29:29.477727 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 455/912] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:29:29.484081 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b1627857-b068-49a4-9382-ff3cb19c5139 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:29.484950 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b1627857-b068-49a4-9382-ff3cb19c5139 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:29.491636 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1627857-b068-49a4-9382-ff3cb19c5139 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:29.492432 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1627857-b068-49a4-9382-ff3cb19c5139 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:29.493077 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1627857-b068-49a4-9382-ff3cb19c5139 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:29.494639 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1627857-b068-49a4-9382-ff3cb19c5139 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:29.495355 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1627857-b068-49a4-9382-ff3cb19c5139 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:29.496132 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b1627857-b068-49a4-9382-ff3cb19c5139 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:29.523175 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b1627857-b068-49a4-9382-ff3cb19c5139 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Going to try to terminate instance {{(pid=120535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:29:29.617180 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b1627857-b068-49a4-9382-ff3cb19c5139 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 204 len: 0 microversion: 2.1 time: 0.137743 Sep 05 12:29:29.618053 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 456/913] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:29:29 2022] DELETE /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:29:29.628030 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7df8a934-3558-4633-a9cc-b5b21158f073 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:29.628873 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7df8a934-3558-4633-a9cc-b5b21158f073 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:29.632048 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:29.640007 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7df8a934-3558-4633-a9cc-b5b21158f073 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:29.640850 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7df8a934-3558-4633-a9cc-b5b21158f073 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:29.641386 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7df8a934-3558-4633-a9cc-b5b21158f073 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:29.642157 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7df8a934-3558-4633-a9cc-b5b21158f073 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:29.642674 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7df8a934-3558-4633-a9cc-b5b21158f073 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:29.643210 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7df8a934-3558-4633-a9cc-b5b21158f073 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:29.834857 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-7df8a934-3558-4633-a9cc-b5b21158f073 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:29.844307 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7df8a934-3558-4633-a9cc-b5b21158f073 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.221719 Sep 05 12:29:29.859554 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 457/914] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:29 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:30.180820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e0147e68-d7d6-4615-ab37-0dc938d364b6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:30.181611 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e0147e68-d7d6-4615-ab37-0dc938d364b6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:30.190828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e0147e68-d7d6-4615-ab37-0dc938d364b6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:30.191128 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e0147e68-d7d6-4615-ab37-0dc938d364b6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:30.191990 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e0147e68-d7d6-4615-ab37-0dc938d364b6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:30.192966 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e0147e68-d7d6-4615-ab37-0dc938d364b6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:30.194078 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e0147e68-d7d6-4615-ab37-0dc938d364b6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:30.195141 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e0147e68-d7d6-4615-ab37-0dc938d364b6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:30.398996 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e0147e68-d7d6-4615-ab37-0dc938d364b6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:30.409901 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e0147e68-d7d6-4615-ab37-0dc938d364b6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:30.411863 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e0147e68-d7d6-4615-ab37-0dc938d364b6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:30.413159 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e0147e68-d7d6-4615-ab37-0dc938d364b6 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.238166 Sep 05 12:29:30.413793 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 458/915] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:30 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:30.418637 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ee14b42a-ba51-4bdd-bbcb-dada71f5946a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:30.420076 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ee14b42a-ba51-4bdd-bbcb-dada71f5946a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:30.426649 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ee14b42a-ba51-4bdd-bbcb-dada71f5946a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:30.427355 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ee14b42a-ba51-4bdd-bbcb-dada71f5946a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:30.428144 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ee14b42a-ba51-4bdd-bbcb-dada71f5946a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:30.429177 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ee14b42a-ba51-4bdd-bbcb-dada71f5946a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:30.429874 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ee14b42a-ba51-4bdd-bbcb-dada71f5946a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:30.430818 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ee14b42a-ba51-4bdd-bbcb-dada71f5946a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:30.598489 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ee14b42a-ba51-4bdd-bbcb-dada71f5946a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:30.607235 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ee14b42a-ba51-4bdd-bbcb-dada71f5946a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.191645 Sep 05 12:29:30.607859 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 459/916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:30 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:30.869094 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-dbd7a5ea-ea00-44b7-be2c-33adcc018974 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:30.870841 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-dbd7a5ea-ea00-44b7-be2c-33adcc018974 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:30.877636 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dbd7a5ea-ea00-44b7-be2c-33adcc018974 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:30.878119 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dbd7a5ea-ea00-44b7-be2c-33adcc018974 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:30.878551 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dbd7a5ea-ea00-44b7-be2c-33adcc018974 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:30.879252 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dbd7a5ea-ea00-44b7-be2c-33adcc018974 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:30.879772 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dbd7a5ea-ea00-44b7-be2c-33adcc018974 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:30.880195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dbd7a5ea-ea00-44b7-be2c-33adcc018974 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:31.033090 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-dbd7a5ea-ea00-44b7-be2c-33adcc018974 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:31.041236 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-dbd7a5ea-ea00-44b7-be2c-33adcc018974 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.176012 Sep 05 12:29:31.043548 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 460/917] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:30 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:31.454092 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5b5cf33c-939f-42d2-b7af-1034b32046a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:31.457095 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5b5cf33c-939f-42d2-b7af-1034b32046a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:31.465343 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b5cf33c-939f-42d2-b7af-1034b32046a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:31.465908 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b5cf33c-939f-42d2-b7af-1034b32046a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:31.466872 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b5cf33c-939f-42d2-b7af-1034b32046a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:31.467625 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b5cf33c-939f-42d2-b7af-1034b32046a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:31.468382 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b5cf33c-939f-42d2-b7af-1034b32046a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:31.468985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5b5cf33c-939f-42d2-b7af-1034b32046a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:31.623786 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5b5cf33c-939f-42d2-b7af-1034b32046a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:31.632317 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5b5cf33c-939f-42d2-b7af-1034b32046a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:31.633764 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5b5cf33c-939f-42d2-b7af-1034b32046a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:31.634933 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5b5cf33c-939f-42d2-b7af-1034b32046a9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.184976 Sep 05 12:29:31.635486 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 461/918] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:31 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:29:31.640382 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2f91c6f2-6dfa-43fd-bf26-f37312d288bb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:31.640982 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2f91c6f2-6dfa-43fd-bf26-f37312d288bb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:31.648883 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2f91c6f2-6dfa-43fd-bf26-f37312d288bb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:31.649374 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2f91c6f2-6dfa-43fd-bf26-f37312d288bb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:31.649833 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2f91c6f2-6dfa-43fd-bf26-f37312d288bb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:31.650518 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2f91c6f2-6dfa-43fd-bf26-f37312d288bb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:31.651061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2f91c6f2-6dfa-43fd-bf26-f37312d288bb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:31.651696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2f91c6f2-6dfa-43fd-bf26-f37312d288bb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:31.816741 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2f91c6f2-6dfa-43fd-bf26-f37312d288bb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:31.824991 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2f91c6f2-6dfa-43fd-bf26-f37312d288bb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.188477 Sep 05 12:29:31.825928 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 462/919] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:31 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:32.071738 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a37e59af-56f5-469f-97d7-46ed26bd338a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:32.073086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a37e59af-56f5-469f-97d7-46ed26bd338a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:32.081474 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a37e59af-56f5-469f-97d7-46ed26bd338a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:32.082110 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a37e59af-56f5-469f-97d7-46ed26bd338a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:32.082692 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a37e59af-56f5-469f-97d7-46ed26bd338a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:32.083472 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a37e59af-56f5-469f-97d7-46ed26bd338a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:32.084384 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a37e59af-56f5-469f-97d7-46ed26bd338a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:32.084606 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a37e59af-56f5-469f-97d7-46ed26bd338a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:32.256310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a37e59af-56f5-469f-97d7-46ed26bd338a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:32.265105 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a37e59af-56f5-469f-97d7-46ed26bd338a tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.200138 Sep 05 12:29:32.266204 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 463/920] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:32 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:32.661178 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6c2c2111-1553-4c20-8bf4-e39dd67651be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:32.662091 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6c2c2111-1553-4c20-8bf4-e39dd67651be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:32.668338 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6c2c2111-1553-4c20-8bf4-e39dd67651be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:32.669553 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6c2c2111-1553-4c20-8bf4-e39dd67651be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:32.670133 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6c2c2111-1553-4c20-8bf4-e39dd67651be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:32.671008 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6c2c2111-1553-4c20-8bf4-e39dd67651be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:32.671637 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6c2c2111-1553-4c20-8bf4-e39dd67651be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:32.672217 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6c2c2111-1553-4c20-8bf4-e39dd67651be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:32.833811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6c2c2111-1553-4c20-8bf4-e39dd67651be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:32.843342 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6c2c2111-1553-4c20-8bf4-e39dd67651be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:32.844912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6c2c2111-1553-4c20-8bf4-e39dd67651be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:32.846221 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6c2c2111-1553-4c20-8bf4-e39dd67651be tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.189257 Sep 05 12:29:32.859952 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 464/921] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:32 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:29:32.870602 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7e7aa119-7236-40f9-b01b-daf140c3185f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:32.871567 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7e7aa119-7236-40f9-b01b-daf140c3185f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:32.878377 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7e7aa119-7236-40f9-b01b-daf140c3185f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:32.878843 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7e7aa119-7236-40f9-b01b-daf140c3185f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:32.879269 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7e7aa119-7236-40f9-b01b-daf140c3185f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:32.879987 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7e7aa119-7236-40f9-b01b-daf140c3185f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:32.880439 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7e7aa119-7236-40f9-b01b-daf140c3185f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:32.880859 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7e7aa119-7236-40f9-b01b-daf140c3185f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:33.038239 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-7e7aa119-7236-40f9-b01b-daf140c3185f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:33.047143 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7e7aa119-7236-40f9-b01b-daf140c3185f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.186043 Sep 05 12:29:33.048072 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 465/922] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:32 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:33.292723 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-da9adb13-ab44-48d4-abd2-f43e109fdd71 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:33.293616 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-da9adb13-ab44-48d4-abd2-f43e109fdd71 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:33.301282 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-da9adb13-ab44-48d4-abd2-f43e109fdd71 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:33.301776 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-da9adb13-ab44-48d4-abd2-f43e109fdd71 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:33.302581 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-da9adb13-ab44-48d4-abd2-f43e109fdd71 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:33.303222 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-da9adb13-ab44-48d4-abd2-f43e109fdd71 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:33.303711 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-da9adb13-ab44-48d4-abd2-f43e109fdd71 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:33.304147 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-da9adb13-ab44-48d4-abd2-f43e109fdd71 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:33.453746 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-da9adb13-ab44-48d4-abd2-f43e109fdd71 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:33.461550 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-da9adb13-ab44-48d4-abd2-f43e109fdd71 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.172792 Sep 05 12:29:33.462066 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 466/923] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:33 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:33.874707 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-98903be2-7804-4265-86be-2d83bacbd4c0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:33.875322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-98903be2-7804-4265-86be-2d83bacbd4c0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:33.881393 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98903be2-7804-4265-86be-2d83bacbd4c0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:33.881873 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98903be2-7804-4265-86be-2d83bacbd4c0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:33.882309 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98903be2-7804-4265-86be-2d83bacbd4c0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:33.883029 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98903be2-7804-4265-86be-2d83bacbd4c0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:33.883486 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98903be2-7804-4265-86be-2d83bacbd4c0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:33.883946 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98903be2-7804-4265-86be-2d83bacbd4c0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:33.899488 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:34.013826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-98903be2-7804-4265-86be-2d83bacbd4c0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:34.021940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-98903be2-7804-4265-86be-2d83bacbd4c0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:34.023364 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-98903be2-7804-4265-86be-2d83bacbd4c0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:34.024531 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-98903be2-7804-4265-86be-2d83bacbd4c0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.154541 Sep 05 12:29:34.025103 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 467/924] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:33 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:29:34.069958 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-02809e37-9bf9-4d8b-a6b7-5dfc41492fe5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:34.070558 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-02809e37-9bf9-4d8b-a6b7-5dfc41492fe5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:34.076424 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02809e37-9bf9-4d8b-a6b7-5dfc41492fe5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:34.076895 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02809e37-9bf9-4d8b-a6b7-5dfc41492fe5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:34.077324 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02809e37-9bf9-4d8b-a6b7-5dfc41492fe5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:34.078000 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02809e37-9bf9-4d8b-a6b7-5dfc41492fe5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:34.078447 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02809e37-9bf9-4d8b-a6b7-5dfc41492fe5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:34.078870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02809e37-9bf9-4d8b-a6b7-5dfc41492fe5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:34.207792 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-02809e37-9bf9-4d8b-a6b7-5dfc41492fe5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:34.215723 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-02809e37-9bf9-4d8b-a6b7-5dfc41492fe5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.149357 Sep 05 12:29:34.216783 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 468/925] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:34 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:34.485512 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6d196237-41b2-4f46-81b5-d27b02a27af0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:34.486131 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6d196237-41b2-4f46-81b5-d27b02a27af0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:34.492606 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6d196237-41b2-4f46-81b5-d27b02a27af0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:34.493322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6d196237-41b2-4f46-81b5-d27b02a27af0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:34.493761 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6d196237-41b2-4f46-81b5-d27b02a27af0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:34.494466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6d196237-41b2-4f46-81b5-d27b02a27af0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:34.494924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6d196237-41b2-4f46-81b5-d27b02a27af0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:34.495351 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6d196237-41b2-4f46-81b5-d27b02a27af0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:34.639475 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6d196237-41b2-4f46-81b5-d27b02a27af0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:34.647454 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6d196237-41b2-4f46-81b5-d27b02a27af0 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.166393 Sep 05 12:29:34.648056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 469/926] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:34 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:35.049622 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-5a3af700-0f3c-4d09-bc4b-4e01f3b2cd60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:35.050232 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-5a3af700-0f3c-4d09-bc4b-4e01f3b2cd60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:35.056190 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a3af700-0f3c-4d09-bc4b-4e01f3b2cd60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:35.056678 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a3af700-0f3c-4d09-bc4b-4e01f3b2cd60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:35.057113 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a3af700-0f3c-4d09-bc4b-4e01f3b2cd60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:35.057800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a3af700-0f3c-4d09-bc4b-4e01f3b2cd60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:35.058261 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a3af700-0f3c-4d09-bc4b-4e01f3b2cd60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:35.058691 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-5a3af700-0f3c-4d09-bc4b-4e01f3b2cd60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:35.190327 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5a3af700-0f3c-4d09-bc4b-4e01f3b2cd60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:35.198799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5a3af700-0f3c-4d09-bc4b-4e01f3b2cd60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:35.200931 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-5a3af700-0f3c-4d09-bc4b-4e01f3b2cd60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:35.202205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-5a3af700-0f3c-4d09-bc4b-4e01f3b2cd60 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.156471 Sep 05 12:29:35.202764 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 470/927] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:35 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:29:35.238556 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0a3466e8-7596-4199-a79c-60a109742b5a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:35.239173 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0a3466e8-7596-4199-a79c-60a109742b5a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:35.249318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0a3466e8-7596-4199-a79c-60a109742b5a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:35.249562 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0a3466e8-7596-4199-a79c-60a109742b5a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:35.250003 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0a3466e8-7596-4199-a79c-60a109742b5a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:35.250737 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0a3466e8-7596-4199-a79c-60a109742b5a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:35.251555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0a3466e8-7596-4199-a79c-60a109742b5a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:35.252061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0a3466e8-7596-4199-a79c-60a109742b5a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:35.405197 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0a3466e8-7596-4199-a79c-60a109742b5a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:35.414488 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0a3466e8-7596-4199-a79c-60a109742b5a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.179773 Sep 05 12:29:35.415267 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 471/928] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:35 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:35.531718 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5242fe1c-6406-4b43-9cf2-e68cbffd3290 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "POST /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.685709 Sep 05 12:29:35.537306 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 458/929] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Sep 5 12:29:28 2022] POST /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments => generated 194 bytes in 6693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:35.672500 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a8919d0d-ad40-446c-a847-2670d22eebc8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:35.673117 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a8919d0d-ad40-446c-a847-2670d22eebc8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:35.679759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a8919d0d-ad40-446c-a847-2670d22eebc8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:35.680511 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a8919d0d-ad40-446c-a847-2670d22eebc8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:35.681140 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a8919d0d-ad40-446c-a847-2670d22eebc8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:35.681853 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a8919d0d-ad40-446c-a847-2670d22eebc8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:35.682315 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a8919d0d-ad40-446c-a847-2670d22eebc8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:35.682740 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a8919d0d-ad40-446c-a847-2670d22eebc8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:36.021138 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a8919d0d-ad40-446c-a847-2670d22eebc8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:36.034919 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a8919d0d-ad40-446c-a847-2670d22eebc8 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1569 microversion: 2.1 time: 0.366707 Sep 05 12:29:36.035552 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 472/930] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:35 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1569 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:36.112321 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-b83a3c5f-4d9b-4ae8-97de-ad12b101e924 req-379dc197-b120-4b87-b6d2-23aefdb744f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4181d872-fbd4-4b16-b8c2-d086dd1253b2", "name": "network-vif-deleted", "tag": "935d1954-274e-487a-b68a-696df548ac2a"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:36.126355 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-b83a3c5f-4d9b-4ae8-97de-ad12b101e924 req-379dc197-b120-4b87-b6d2-23aefdb744f0 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:36.126995 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-b83a3c5f-4d9b-4ae8-97de-ad12b101e924 req-379dc197-b120-4b87-b6d2-23aefdb744f0 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:36.127824 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-b83a3c5f-4d9b-4ae8-97de-ad12b101e924 req-379dc197-b120-4b87-b6d2-23aefdb744f0 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:36.141265 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-b83a3c5f-4d9b-4ae8-97de-ad12b101e924 req-379dc197-b120-4b87-b6d2-23aefdb744f0 service nova] Creating event network-vif-deleted:935d1954-274e-487a-b68a-696df548ac2a for instance 4181d872-fbd4-4b16-b8c2-d086dd1253b2 on hv-cinder-85518 Sep 05 12:29:36.147142 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-b83a3c5f-4d9b-4ae8-97de-ad12b101e924 req-379dc197-b120-4b87-b6d2-23aefdb744f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039311 Sep 05 12:29:36.148102 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 459/931] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:36.228526 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-15213307-c298-4679-977f-b1b16c82e197 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:36.229214 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-15213307-c298-4679-977f-b1b16c82e197 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:36.235517 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-15213307-c298-4679-977f-b1b16c82e197 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:36.236187 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-15213307-c298-4679-977f-b1b16c82e197 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:36.236903 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-15213307-c298-4679-977f-b1b16c82e197 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:36.237706 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-15213307-c298-4679-977f-b1b16c82e197 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:36.238390 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-15213307-c298-4679-977f-b1b16c82e197 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:36.239058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-15213307-c298-4679-977f-b1b16c82e197 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:36.401581 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-15213307-c298-4679-977f-b1b16c82e197 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:36.411843 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-15213307-c298-4679-977f-b1b16c82e197 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:36.413548 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-15213307-c298-4679-977f-b1b16c82e197 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:36.414973 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-15213307-c298-4679-977f-b1b16c82e197 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.190491 Sep 05 12:29:36.415737 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 473/932] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:36 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:36.440463 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9be45c7d-419a-4b2c-8c1e-bc3e713e4884 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:36.441644 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9be45c7d-419a-4b2c-8c1e-bc3e713e4884 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:36.453114 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9be45c7d-419a-4b2c-8c1e-bc3e713e4884 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:36.453870 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9be45c7d-419a-4b2c-8c1e-bc3e713e4884 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:36.454480 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9be45c7d-419a-4b2c-8c1e-bc3e713e4884 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:36.455403 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9be45c7d-419a-4b2c-8c1e-bc3e713e4884 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:36.456199 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9be45c7d-419a-4b2c-8c1e-bc3e713e4884 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:36.456984 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9be45c7d-419a-4b2c-8c1e-bc3e713e4884 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:36.669791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9be45c7d-419a-4b2c-8c1e-bc3e713e4884 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:36.681506 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9be45c7d-419a-4b2c-8c1e-bc3e713e4884 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.246870 Sep 05 12:29:36.682558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 460/933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:36 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:37.058205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7de34d24-4e61-452c-b923-e230df175998 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:37.058826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7de34d24-4e61-452c-b923-e230df175998 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:37.065785 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7de34d24-4e61-452c-b923-e230df175998 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:37.066344 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7de34d24-4e61-452c-b923-e230df175998 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:37.066709 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7de34d24-4e61-452c-b923-e230df175998 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:37.067488 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7de34d24-4e61-452c-b923-e230df175998 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:37.068048 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7de34d24-4e61-452c-b923-e230df175998 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:37.068485 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7de34d24-4e61-452c-b923-e230df175998 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:37.132398 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-7de34d24-4e61-452c-b923-e230df175998 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ff56403efde4509bc830967a1c25ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e8ed647b3845119144655e27322ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:37.140661 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7de34d24-4e61-452c-b923-e230df175998 tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 200 len: 1382 microversion: 2.1 time: 0.086286 Sep 05 12:29:37.141470 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 474/934] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:37 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 1382 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:37.443826 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-adf4451c-10fb-4627-8dd9-8c284a96ac2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:37.444453 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-adf4451c-10fb-4627-8dd9-8c284a96ac2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:37.451979 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-adf4451c-10fb-4627-8dd9-8c284a96ac2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:37.452477 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-adf4451c-10fb-4627-8dd9-8c284a96ac2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:37.452927 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-adf4451c-10fb-4627-8dd9-8c284a96ac2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:37.453647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-adf4451c-10fb-4627-8dd9-8c284a96ac2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:37.454107 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-adf4451c-10fb-4627-8dd9-8c284a96ac2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:37.454548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-adf4451c-10fb-4627-8dd9-8c284a96ac2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:37.589666 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-adf4451c-10fb-4627-8dd9-8c284a96ac2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:37.598466 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-adf4451c-10fb-4627-8dd9-8c284a96ac2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:37.600018 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-adf4451c-10fb-4627-8dd9-8c284a96ac2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:37.601173 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-adf4451c-10fb-4627-8dd9-8c284a96ac2f tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.163029 Sep 05 12:29:37.601735 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 461/935] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:37 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:37.706061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f3848a8c-baa5-4ff5-88a1-a4bed70db5bf tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:37.707273 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f3848a8c-baa5-4ff5-88a1-a4bed70db5bf tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:37.723623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f3848a8c-baa5-4ff5-88a1-a4bed70db5bf tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:37.723623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f3848a8c-baa5-4ff5-88a1-a4bed70db5bf tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:37.723623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f3848a8c-baa5-4ff5-88a1-a4bed70db5bf tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:37.723623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f3848a8c-baa5-4ff5-88a1-a4bed70db5bf tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:37.724128 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f3848a8c-baa5-4ff5-88a1-a4bed70db5bf tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:37.724128 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f3848a8c-baa5-4ff5-88a1-a4bed70db5bf tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:37.861509 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f3848a8c-baa5-4ff5-88a1-a4bed70db5bf tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:37.869219 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f3848a8c-baa5-4ff5-88a1-a4bed70db5bf tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.167218 Sep 05 12:29:37.869781 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 475/936] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:37 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:38.165825 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-bf6b78b8-7de7-47d1-a3e1-70d3039f898d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:38.166377 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-bf6b78b8-7de7-47d1-a3e1-70d3039f898d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] [instance: 4181d872-fbd4-4b16-b8c2-d086dd1253b2] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:38.172889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bf6b78b8-7de7-47d1-a3e1-70d3039f898d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.173373 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bf6b78b8-7de7-47d1-a3e1-70d3039f898d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.173813 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bf6b78b8-7de7-47d1-a3e1-70d3039f898d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:38.174506 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bf6b78b8-7de7-47d1-a3e1-70d3039f898d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.174966 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bf6b78b8-7de7-47d1-a3e1-70d3039f898d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.175398 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bf6b78b8-7de7-47d1-a3e1-70d3039f898d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:38.189082 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-bf6b78b8-7de7-47d1-a3e1-70d3039f898d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] HTTP exception thrown: Instance 4181d872-fbd4-4b16-b8c2-d086dd1253b2 could not be found. Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-bf6b78b8-7de7-47d1-a3e1-70d3039f898d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Request method failure captured: Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 HTTP/1.1 Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFenxiclsvGgPD-5xmEYsnT-IHPwGBbdfA9OvDiSWxxBMMNB02BmVvujXR_YUtZDUYAcWBL2WN9hanl4QzFCGasCsUdeZyDBWKsvZY8nB6P3ex_3b1SNHu527wRkEQD14K_Eslci7fSKWiBqq5BcXPt1C-Ub5RLaztXaz1ba9QNqkBxc Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 88e8ed647b3845119144655e27322ae1 Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-TestShelveInstance-2136766268 Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:29:38.190724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:29:38.192272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_88e8ed647b3845119144655e27322ae1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/88e8ed647b3845119144655e27322ae1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/88e8ed647b3845119144655e27322ae1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/88e8ed647b3845119144655e27322ae1"}]}] Sep 05 12:29:38.192272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-TestShelveInstance-2136766268 Sep 05 12:29:38.192272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 88e8ed647b3845119144655e27322ae1 Sep 05 12:29:38.192272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-TestShelveInstance-2136766268 Sep 05 12:29:38.192272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-TestShelveInstance-2136766268-project Sep 05 12:29:38.192272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:29:38.192272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:29:38.192272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 8ff56403efde4509bc830967a1c25ccc Sep 05 12:29:38.192272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-TestShelveInstance-2136766268-project Sep 05 12:29:38.192272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:29:38.192272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 4181d872-fbd4-4b16-b8c2-d086dd1253b2 could not be found. Sep 05 12:29:38.192272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '4181d872-fbd4-4b16-b8c2-d086dd1253b2'} Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4181d872-fbd4-4b16-b8c2-d086dd1253b2 could not be found. Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:29:38.193109 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4181d872-fbd4-4b16-b8c2-d086dd1253b2 could not be found. Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4181d872-fbd4-4b16-b8c2-d086dd1253b2 could not be found. Sep 05 12:29:38.194653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:29:38.196240 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-bf6b78b8-7de7-47d1-a3e1-70d3039f898d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Returning 404 to user: Instance 4181d872-fbd4-4b16-b8c2-d086dd1253b2 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:29:38.196240 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-bf6b78b8-7de7-47d1-a3e1-70d3039f898d tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2" status: 404 len: 111 microversion: 2.1 time: 0.030344 Sep 05 12:29:38.196240 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 462/937] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:38 2022] GET /compute/v2.1/servers/4181d872-fbd4-4b16-b8c2-d086dd1253b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:29:38.617860 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e8d5a705-09b3-48a7-8c03-13ad1e1c57df tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] Calling method '.version_select at 0x7fba4b89cdc0>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:38.628105 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-15e2229c-a689-4cfe-8188-892f49329ebb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:38.630581 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-15e2229c-a689-4cfe-8188-892f49329ebb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:38.643335 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-15e2229c-a689-4cfe-8188-892f49329ebb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.643862 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-15e2229c-a689-4cfe-8188-892f49329ebb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.644304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-15e2229c-a689-4cfe-8188-892f49329ebb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:38.645015 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-15e2229c-a689-4cfe-8188-892f49329ebb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.645474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-15e2229c-a689-4cfe-8188-892f49329ebb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.645903 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-15e2229c-a689-4cfe-8188-892f49329ebb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:38.662712 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e8d5a705-09b3-48a7-8c03-13ad1e1c57df tempest-TestShelveInstance-2136766268 tempest-TestShelveInstance-2136766268-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1449146137" status: 202 len: 0 microversion: 2.1 time: 0.048601 Sep 05 12:29:38.663573 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 476/938] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Sep 5 12:29:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1449146137 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:29:38.762575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-cd9ccd24-4162-4206-90f0-5438f9e074da req-7e7f1f83-ecca-44c0-8dd9-cb0c0629d07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0055a73c-7732-48a3-b76b-3b8cc28e7804", "name": "network-vif-plugged", "status": "completed", "tag": "a65b6d21-8474-43a9-bb2b-2b6a76c853f9"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:38.784951 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-cd9ccd24-4162-4206-90f0-5438f9e074da req-7e7f1f83-ecca-44c0-8dd9-cb0c0629d07f service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.785415 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-cd9ccd24-4162-4206-90f0-5438f9e074da req-7e7f1f83-ecca-44c0-8dd9-cb0c0629d07f service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.785864 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-cd9ccd24-4162-4206-90f0-5438f9e074da req-7e7f1f83-ecca-44c0-8dd9-cb0c0629d07f service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:38.808093 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-cd9ccd24-4162-4206-90f0-5438f9e074da req-7e7f1f83-ecca-44c0-8dd9-cb0c0629d07f service nova] Creating event network-vif-plugged:a65b6d21-8474-43a9-bb2b-2b6a76c853f9 for instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 on hv-cinder-85518 Sep 05 12:29:38.822446 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-cd9ccd24-4162-4206-90f0-5438f9e074da req-7e7f1f83-ecca-44c0-8dd9-cb0c0629d07f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061206 Sep 05 12:29:38.826324 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 477/939] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:29:38.861570 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-15e2229c-a689-4cfe-8188-892f49329ebb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:38.870582 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-15e2229c-a689-4cfe-8188-892f49329ebb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:38.872060 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-15e2229c-a689-4cfe-8188-892f49329ebb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:38.873291 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-15e2229c-a689-4cfe-8188-892f49329ebb tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.249793 Sep 05 12:29:38.873983 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 463/940] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:38 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:38.892439 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-155ef0d5-2d75-406a-aba1-5ef1f12ce885 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:38.893185 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-155ef0d5-2d75-406a-aba1-5ef1f12ce885 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:38.899805 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-155ef0d5-2d75-406a-aba1-5ef1f12ce885 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.900303 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-155ef0d5-2d75-406a-aba1-5ef1f12ce885 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.900746 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-155ef0d5-2d75-406a-aba1-5ef1f12ce885 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:38.901448 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-155ef0d5-2d75-406a-aba1-5ef1f12ce885 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.901905 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-155ef0d5-2d75-406a-aba1-5ef1f12ce885 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.902592 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-155ef0d5-2d75-406a-aba1-5ef1f12ce885 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:39.184031 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-155ef0d5-2d75-406a-aba1-5ef1f12ce885 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:39.192850 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-155ef0d5-2d75-406a-aba1-5ef1f12ce885 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.304450 Sep 05 12:29:39.207857 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 478/941] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:38 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:39.898507 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-98eb884d-b923-4009-a32c-e7b974a286f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:39.899260 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-98eb884d-b923-4009-a32c-e7b974a286f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:39.906323 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98eb884d-b923-4009-a32c-e7b974a286f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:39.906811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98eb884d-b923-4009-a32c-e7b974a286f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:39.907249 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98eb884d-b923-4009-a32c-e7b974a286f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:39.907973 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98eb884d-b923-4009-a32c-e7b974a286f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:39.908431 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98eb884d-b923-4009-a32c-e7b974a286f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:39.908870 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-98eb884d-b923-4009-a32c-e7b974a286f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:40.040502 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-98eb884d-b923-4009-a32c-e7b974a286f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:40.049509 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-98eb884d-b923-4009-a32c-e7b974a286f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:40.050970 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-98eb884d-b923-4009-a32c-e7b974a286f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:40.052178 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-98eb884d-b923-4009-a32c-e7b974a286f5 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.157740 Sep 05 12:29:40.052740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 464/942] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:39 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:40.218533 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-24c2b671-02e7-4bc6-b0cb-93cce2b481f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:40.219827 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-24c2b671-02e7-4bc6-b0cb-93cce2b481f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:40.226956 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-24c2b671-02e7-4bc6-b0cb-93cce2b481f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:40.227817 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-24c2b671-02e7-4bc6-b0cb-93cce2b481f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:40.228323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-24c2b671-02e7-4bc6-b0cb-93cce2b481f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:40.229099 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-24c2b671-02e7-4bc6-b0cb-93cce2b481f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:40.229640 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-24c2b671-02e7-4bc6-b0cb-93cce2b481f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:40.230307 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-24c2b671-02e7-4bc6-b0cb-93cce2b481f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:40.468844 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-24c2b671-02e7-4bc6-b0cb-93cce2b481f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:40.476460 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-24c2b671-02e7-4bc6-b0cb-93cce2b481f9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.263793 Sep 05 12:29:40.477016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 479/943] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:40 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:41.080766 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9a2c0d80-a093-4ae7-ab7c-e89417fc8e8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:41.087145 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9a2c0d80-a093-4ae7-ab7c-e89417fc8e8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:41.096244 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9a2c0d80-a093-4ae7-ab7c-e89417fc8e8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:41.096834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9a2c0d80-a093-4ae7-ab7c-e89417fc8e8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:41.097345 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9a2c0d80-a093-4ae7-ab7c-e89417fc8e8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:41.098130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9a2c0d80-a093-4ae7-ab7c-e89417fc8e8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:41.098653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9a2c0d80-a093-4ae7-ab7c-e89417fc8e8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:41.099454 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9a2c0d80-a093-4ae7-ab7c-e89417fc8e8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:41.287433 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9a2c0d80-a093-4ae7-ab7c-e89417fc8e8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:41.301361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9a2c0d80-a093-4ae7-ab7c-e89417fc8e8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:41.304121 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9a2c0d80-a093-4ae7-ab7c-e89417fc8e8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:41.305360 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9a2c0d80-a093-4ae7-ab7c-e89417fc8e8b tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1730 microversion: 2.20 time: 0.230448 Sep 05 12:29:41.307932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 465/944] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:41 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:41.500502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8fcb6297-b718-494c-bb29-76600129d2d0 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:41.501128 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8fcb6297-b718-494c-bb29-76600129d2d0 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:41.511229 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8fcb6297-b718-494c-bb29-76600129d2d0 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:41.511962 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8fcb6297-b718-494c-bb29-76600129d2d0 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:41.512434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8fcb6297-b718-494c-bb29-76600129d2d0 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:41.513187 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8fcb6297-b718-494c-bb29-76600129d2d0 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:41.513628 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8fcb6297-b718-494c-bb29-76600129d2d0 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:41.514061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8fcb6297-b718-494c-bb29-76600129d2d0 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:41.661780 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8fcb6297-b718-494c-bb29-76600129d2d0 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:41.670291 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8fcb6297-b718-494c-bb29-76600129d2d0 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.174917 Sep 05 12:29:41.670868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 480/945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:41 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:42.335738 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-bfb6d60c-b9f9-446e-a19a-291369df6691 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:42.336365 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-bfb6d60c-b9f9-446e-a19a-291369df6691 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:42.344071 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bfb6d60c-b9f9-446e-a19a-291369df6691 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:42.344553 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bfb6d60c-b9f9-446e-a19a-291369df6691 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:42.344991 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bfb6d60c-b9f9-446e-a19a-291369df6691 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:42.345701 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bfb6d60c-b9f9-446e-a19a-291369df6691 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:42.346158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bfb6d60c-b9f9-446e-a19a-291369df6691 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:42.346585 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bfb6d60c-b9f9-446e-a19a-291369df6691 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:42.496338 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-bfb6d60c-b9f9-446e-a19a-291369df6691 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:42.505597 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-bfb6d60c-b9f9-446e-a19a-291369df6691 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:42.507484 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-bfb6d60c-b9f9-446e-a19a-291369df6691 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:42.508870 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-bfb6d60c-b9f9-446e-a19a-291369df6691 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1717 microversion: 2.20 time: 0.177016 Sep 05 12:29:42.509486 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 466/946] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:42 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1717 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:42.695190 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-33bfec28-14db-4aa8-a78b-24a866dc3bab tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:42.697083 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-33bfec28-14db-4aa8-a78b-24a866dc3bab tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:42.704497 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-33bfec28-14db-4aa8-a78b-24a866dc3bab tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:42.705067 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-33bfec28-14db-4aa8-a78b-24a866dc3bab tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:42.705425 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-33bfec28-14db-4aa8-a78b-24a866dc3bab tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:42.706344 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-33bfec28-14db-4aa8-a78b-24a866dc3bab tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:42.706805 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-33bfec28-14db-4aa8-a78b-24a866dc3bab tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:42.707272 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-33bfec28-14db-4aa8-a78b-24a866dc3bab tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:42.844178 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-33bfec28-14db-4aa8-a78b-24a866dc3bab tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:42.851881 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-33bfec28-14db-4aa8-a78b-24a866dc3bab tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.161475 Sep 05 12:29:42.852457 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 481/947] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:42 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:43.875244 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2c0de6c3-f859-467a-9059-16a849ea00e2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:43.875970 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2c0de6c3-f859-467a-9059-16a849ea00e2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:43.882834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c0de6c3-f859-467a-9059-16a849ea00e2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:43.883387 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c0de6c3-f859-467a-9059-16a849ea00e2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:43.883990 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c0de6c3-f859-467a-9059-16a849ea00e2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:43.884829 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c0de6c3-f859-467a-9059-16a849ea00e2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:43.885348 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c0de6c3-f859-467a-9059-16a849ea00e2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:43.885841 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2c0de6c3-f859-467a-9059-16a849ea00e2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:44.131730 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2c0de6c3-f859-467a-9059-16a849ea00e2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:44.136458 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:44.144891 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2c0de6c3-f859-467a-9059-16a849ea00e2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.273424 Sep 05 12:29:44.152442 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 467/948] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:43 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:45.168921 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-3754c4cd-ffce-47b2-9ba2-6d4581f301bd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:45.171325 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3754c4cd-ffce-47b2-9ba2-6d4581f301bd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:45.180534 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3754c4cd-ffce-47b2-9ba2-6d4581f301bd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:45.181422 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3754c4cd-ffce-47b2-9ba2-6d4581f301bd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:45.182014 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3754c4cd-ffce-47b2-9ba2-6d4581f301bd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:45.182915 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3754c4cd-ffce-47b2-9ba2-6d4581f301bd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:45.183572 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3754c4cd-ffce-47b2-9ba2-6d4581f301bd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:45.184161 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3754c4cd-ffce-47b2-9ba2-6d4581f301bd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:45.310193 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ae431319-ef79-4e6a-8548-a8f67bb943b2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:45.312535 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ae431319-ef79-4e6a-8548-a8f67bb943b2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:45.325725 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ae431319-ef79-4e6a-8548-a8f67bb943b2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:45.326592 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ae431319-ef79-4e6a-8548-a8f67bb943b2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:45.327211 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ae431319-ef79-4e6a-8548-a8f67bb943b2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:45.328029 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ae431319-ef79-4e6a-8548-a8f67bb943b2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:45.328706 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ae431319-ef79-4e6a-8548-a8f67bb943b2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:45.329332 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ae431319-ef79-4e6a-8548-a8f67bb943b2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:45.377574 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ae431319-ef79-4e6a-8548-a8f67bb943b2 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071058 Sep 05 12:29:45.378274 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 468/949] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:29:45 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:29:45.390837 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d0a11ef1-1742-48c7-954f-ffe3435b936f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:45.391809 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d0a11ef1-1742-48c7-954f-ffe3435b936f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:45.398155 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d0a11ef1-1742-48c7-954f-ffe3435b936f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:45.398653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d0a11ef1-1742-48c7-954f-ffe3435b936f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:45.399111 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d0a11ef1-1742-48c7-954f-ffe3435b936f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:45.399891 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d0a11ef1-1742-48c7-954f-ffe3435b936f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:45.400348 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d0a11ef1-1742-48c7-954f-ffe3435b936f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:45.400966 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d0a11ef1-1742-48c7-954f-ffe3435b936f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:45.436316 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d0a11ef1-1742-48c7-954f-ffe3435b936f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments/3e512bab-1999-4a9a-8666-232313a85370" status: 200 len: 194 microversion: 2.1 time: 0.050398 Sep 05 12:29:45.442305 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 469/950] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Sep 5 12:29:45 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments/3e512bab-1999-4a9a-8666-232313a85370 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:29:45.465847 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-3754c4cd-ffce-47b2-9ba2-6d4581f301bd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:45.475365 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-3754c4cd-ffce-47b2-9ba2-6d4581f301bd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.310994 Sep 05 12:29:45.488712 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 482/951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:45 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:46.500270 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-16356fd1-4906-4923-8ab2-80f18df05e18 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:46.500936 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-16356fd1-4906-4923-8ab2-80f18df05e18 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:46.507338 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16356fd1-4906-4923-8ab2-80f18df05e18 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.508061 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16356fd1-4906-4923-8ab2-80f18df05e18 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.508669 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16356fd1-4906-4923-8ab2-80f18df05e18 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:46.509368 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16356fd1-4906-4923-8ab2-80f18df05e18 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.509839 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16356fd1-4906-4923-8ab2-80f18df05e18 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.510248 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-16356fd1-4906-4923-8ab2-80f18df05e18 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:46.652459 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-16356fd1-4906-4923-8ab2-80f18df05e18 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:46.661790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-16356fd1-4906-4923-8ab2-80f18df05e18 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.165774 Sep 05 12:29:46.662623 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 470/952] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:46 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:46.822940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-13c92426-8a33-4562-b051-50abc16674ce req-1da562a4-9d59-45ad-8054-8255c252864f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d5a4f8-842e-423f-9974-d6d49a1b3bbb", "name": "network-vif-plugged", "status": "completed", "tag": "23399c5d-28fe-401d-861b-d0a48db49404"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:46.833306 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-13c92426-8a33-4562-b051-50abc16674ce req-1da562a4-9d59-45ad-8054-8255c252864f service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.834135 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-13c92426-8a33-4562-b051-50abc16674ce req-1da562a4-9d59-45ad-8054-8255c252864f service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.834731 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-13c92426-8a33-4562-b051-50abc16674ce req-1da562a4-9d59-45ad-8054-8255c252864f service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:46.848043 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-13c92426-8a33-4562-b051-50abc16674ce req-1da562a4-9d59-45ad-8054-8255c252864f service nova] Creating event network-vif-plugged:23399c5d-28fe-401d-861b-d0a48db49404 for instance 11d5a4f8-842e-423f-9974-d6d49a1b3bbb on hv-cinder-85518 Sep 05 12:29:46.853207 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-13c92426-8a33-4562-b051-50abc16674ce req-1da562a4-9d59-45ad-8054-8255c252864f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035103 Sep 05 12:29:46.858075 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 483/953] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:46.886623 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-37fea6c0-46cd-4d7d-a5b6-7c0fe0e7b033 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e016a096-5555-4136-9095-cd5c4b757826"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:46.889831 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-37fea6c0-46cd-4d7d-a5b6-7c0fe0e7b033 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:46.896148 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37fea6c0-46cd-4d7d-a5b6-7c0fe0e7b033 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.896889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37fea6c0-46cd-4d7d-a5b6-7c0fe0e7b033 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.897598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37fea6c0-46cd-4d7d-a5b6-7c0fe0e7b033 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:46.898372 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37fea6c0-46cd-4d7d-a5b6-7c0fe0e7b033 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.898989 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37fea6c0-46cd-4d7d-a5b6-7c0fe0e7b033 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.899647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-37fea6c0-46cd-4d7d-a5b6-7c0fe0e7b033 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:47.243251 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-37fea6c0-46cd-4d7d-a5b6-7c0fe0e7b033 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "POST /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360401 Sep 05 12:29:47.243919 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 471/954] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Sep 5 12:29:46 2022] POST /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:47.686464 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-3a1fad7d-00ce-47e1-9f8f-fd5886dc88d5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:47.687262 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3a1fad7d-00ce-47e1-9f8f-fd5886dc88d5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:47.693667 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3a1fad7d-00ce-47e1-9f8f-fd5886dc88d5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:47.694183 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3a1fad7d-00ce-47e1-9f8f-fd5886dc88d5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:47.694626 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3a1fad7d-00ce-47e1-9f8f-fd5886dc88d5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:47.695325 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3a1fad7d-00ce-47e1-9f8f-fd5886dc88d5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:47.695821 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3a1fad7d-00ce-47e1-9f8f-fd5886dc88d5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:47.696248 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3a1fad7d-00ce-47e1-9f8f-fd5886dc88d5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:47.828939 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-3a1fad7d-00ce-47e1-9f8f-fd5886dc88d5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:47.837431 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-3a1fad7d-00ce-47e1-9f8f-fd5886dc88d5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1263 microversion: 2.1 time: 0.155701 Sep 05 12:29:47.837988 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 484/955] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:47 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:48.860702 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ffbf283d-aae5-4604-9202-733af0fb9cb7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:48.861424 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ffbf283d-aae5-4604-9202-733af0fb9cb7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:48.868369 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ffbf283d-aae5-4604-9202-733af0fb9cb7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:48.868859 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ffbf283d-aae5-4604-9202-733af0fb9cb7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:48.869302 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ffbf283d-aae5-4604-9202-733af0fb9cb7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:48.870002 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ffbf283d-aae5-4604-9202-733af0fb9cb7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:48.870461 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ffbf283d-aae5-4604-9202-733af0fb9cb7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:48.870893 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ffbf283d-aae5-4604-9202-733af0fb9cb7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:49.001406 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ffbf283d-aae5-4604-9202-733af0fb9cb7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:49.009215 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ffbf283d-aae5-4604-9202-733af0fb9cb7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1450 microversion: 2.1 time: 0.153150 Sep 05 12:29:49.009789 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 472/956] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:48 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:49.031208 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-cd0020ac-edb9-4c49-a368-0e41cdb49ac6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:49.031842 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-cd0020ac-edb9-4c49-a368-0e41cdb49ac6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:49.038171 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd0020ac-edb9-4c49-a368-0e41cdb49ac6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:49.038652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd0020ac-edb9-4c49-a368-0e41cdb49ac6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:49.039072 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd0020ac-edb9-4c49-a368-0e41cdb49ac6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:49.039781 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd0020ac-edb9-4c49-a368-0e41cdb49ac6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:49.040233 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd0020ac-edb9-4c49-a368-0e41cdb49ac6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:49.040654 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cd0020ac-edb9-4c49-a368-0e41cdb49ac6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:49.176171 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-cd0020ac-edb9-4c49-a368-0e41cdb49ac6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:49.183953 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-cd0020ac-edb9-4c49-a368-0e41cdb49ac6 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1450 microversion: 2.1 time: 0.156772 Sep 05 12:29:49.184576 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 485/957] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:49 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:50.766574 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-e37428d3-ae1b-4dfa-861e-c7b6d6299ea8 req-158735be-5cf9-45af-93f9-843ccce69963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11d5a4f8-842e-423f-9974-d6d49a1b3bbb", "tag": "23399c5d-28fe-401d-861b-d0a48db49404"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:50.776403 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-e37428d3-ae1b-4dfa-861e-c7b6d6299ea8 req-158735be-5cf9-45af-93f9-843ccce69963 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:50.777138 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-e37428d3-ae1b-4dfa-861e-c7b6d6299ea8 req-158735be-5cf9-45af-93f9-843ccce69963 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:50.777645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-e37428d3-ae1b-4dfa-861e-c7b6d6299ea8 req-158735be-5cf9-45af-93f9-843ccce69963 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:50.789669 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-e37428d3-ae1b-4dfa-861e-c7b6d6299ea8 req-158735be-5cf9-45af-93f9-843ccce69963 service nova] Creating event network-changed:23399c5d-28fe-401d-861b-d0a48db49404 for instance 11d5a4f8-842e-423f-9974-d6d49a1b3bbb on hv-cinder-85518 Sep 05 12:29:50.795114 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-e37428d3-ae1b-4dfa-861e-c7b6d6299ea8 req-158735be-5cf9-45af-93f9-843ccce69963 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032177 Sep 05 12:29:50.795951 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 473/958] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:56.916147 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9645c571-e5df-40cf-b2ef-e7378829c5bf tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:56.918330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-9645c571-e5df-40cf-b2ef-e7378829c5bf tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:56.925060 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9645c571-e5df-40cf-b2ef-e7378829c5bf tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:56.925540 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9645c571-e5df-40cf-b2ef-e7378829c5bf tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:56.925980 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9645c571-e5df-40cf-b2ef-e7378829c5bf tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:56.926663 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9645c571-e5df-40cf-b2ef-e7378829c5bf tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:56.927116 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9645c571-e5df-40cf-b2ef-e7378829c5bf tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:56.927568 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9645c571-e5df-40cf-b2ef-e7378829c5bf tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:56.941692 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=100 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:56.959262 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9645c571-e5df-40cf-b2ef-e7378829c5bf tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047020 Sep 05 12:29:56.959875 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 486/959] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:29:56 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:57.098375 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5736860e-01e7-47d6-8df1-7a105bc206af tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:57.098947 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5736860e-01e7-47d6-8df1-7a105bc206af tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:57.104991 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5736860e-01e7-47d6-8df1-7a105bc206af tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:57.105471 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5736860e-01e7-47d6-8df1-7a105bc206af tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:57.105906 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5736860e-01e7-47d6-8df1-7a105bc206af tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:57.106589 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5736860e-01e7-47d6-8df1-7a105bc206af tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:57.107566 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5736860e-01e7-47d6-8df1-7a105bc206af tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:57.107989 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5736860e-01e7-47d6-8df1-7a105bc206af tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:57.137522 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5736860e-01e7-47d6-8df1-7a105bc206af tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments/3e512bab-1999-4a9a-8666-232313a85370" status: 200 len: 194 microversion: 2.1 time: 0.044005 Sep 05 12:29:57.138121 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 474/960] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Sep 5 12:29:57 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments/3e512bab-1999-4a9a-8666-232313a85370 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:57.148587 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8af57598-bdd7-4962-9951-cc34e987cba9 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:57.149116 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8af57598-bdd7-4962-9951-cc34e987cba9 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:57.155652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8af57598-bdd7-4962-9951-cc34e987cba9 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:57.156137 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8af57598-bdd7-4962-9951-cc34e987cba9 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:57.156571 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8af57598-bdd7-4962-9951-cc34e987cba9 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:57.157272 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8af57598-bdd7-4962-9951-cc34e987cba9 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:57.157726 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8af57598-bdd7-4962-9951-cc34e987cba9 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:57.158150 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8af57598-bdd7-4962-9951-cc34e987cba9 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:57.245215 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-8af57598-bdd7-4962-9951-cc34e987cba9 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lazy-loading 'services' on Instance uuid 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:29:57.323197 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8af57598-bdd7-4962-9951-cc34e987cba9 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments/3e512bab-1999-4a9a-8666-232313a85370" status: 202 len: 0 microversion: 2.1 time: 0.178437 Sep 05 12:29:57.323926 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 487/961] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Sep 5 12:29:57 2022] DELETE /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments/3e512bab-1999-4a9a-8666-232313a85370 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:29:59.518469 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a38006e7-48a6-47fa-be6e-c44de2abb557 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:59.518970 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a38006e7-48a6-47fa-be6e-c44de2abb557 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:59.521416 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=36 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:59.526973 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a38006e7-48a6-47fa-be6e-c44de2abb557 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:59.527458 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a38006e7-48a6-47fa-be6e-c44de2abb557 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:59.527923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a38006e7-48a6-47fa-be6e-c44de2abb557 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:59.528614 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a38006e7-48a6-47fa-be6e-c44de2abb557 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:59.529074 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a38006e7-48a6-47fa-be6e-c44de2abb557 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:59.529505 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a38006e7-48a6-47fa-be6e-c44de2abb557 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:59.560461 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a38006e7-48a6-47fa-be6e-c44de2abb557 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments/e016a096-5555-4136-9095-cd5c4b757826" status: 200 len: 194 microversion: 2.1 time: 0.046214 Sep 05 12:29:59.561037 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 475/962] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Sep 5 12:29:59 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments/e016a096-5555-4136-9095-cd5c4b757826 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:59.573499 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-62981a12-6f5e-4dbe-8289-e243b0631ff7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:59.574078 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-62981a12-6f5e-4dbe-8289-e243b0631ff7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:59.580431 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62981a12-6f5e-4dbe-8289-e243b0631ff7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:59.580920 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62981a12-6f5e-4dbe-8289-e243b0631ff7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:59.581352 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62981a12-6f5e-4dbe-8289-e243b0631ff7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:59.582074 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62981a12-6f5e-4dbe-8289-e243b0631ff7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:59.582527 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62981a12-6f5e-4dbe-8289-e243b0631ff7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:59.582957 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-62981a12-6f5e-4dbe-8289-e243b0631ff7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:59.665282 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-62981a12-6f5e-4dbe-8289-e243b0631ff7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lazy-loading 'services' on Instance uuid 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:29:59.748502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-62981a12-6f5e-4dbe-8289-e243b0631ff7 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments/e016a096-5555-4136-9095-cd5c4b757826" status: 202 len: 0 microversion: 2.1 time: 0.179619 Sep 05 12:29:59.749099 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 488/963] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Sep 5 12:29:59 2022] DELETE /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments/e016a096-5555-4136-9095-cd5c4b757826 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:30:00.924614 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1964b38f-67e5-40de-91ad-0a730a1adfed tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:00.926782 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1964b38f-67e5-40de-91ad-0a730a1adfed tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:00.933446 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1964b38f-67e5-40de-91ad-0a730a1adfed tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:00.933940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1964b38f-67e5-40de-91ad-0a730a1adfed tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:00.934444 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1964b38f-67e5-40de-91ad-0a730a1adfed tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:00.935160 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1964b38f-67e5-40de-91ad-0a730a1adfed tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:00.935636 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1964b38f-67e5-40de-91ad-0a730a1adfed tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:00.936086 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1964b38f-67e5-40de-91ad-0a730a1adfed tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:00.966903 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1964b38f-67e5-40de-91ad-0a730a1adfed tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046719 Sep 05 12:30:00.967463 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 476/964] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:30:00 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:30:01.083458 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-058852b0-552c-40d4-8f52-024d4913a56f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:01.085868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-058852b0-552c-40d4-8f52-024d4913a56f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:01.087849 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:01.093851 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-058852b0-552c-40d4-8f52-024d4913a56f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:01.094333 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-058852b0-552c-40d4-8f52-024d4913a56f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:01.094768 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-058852b0-552c-40d4-8f52-024d4913a56f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:01.095458 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-058852b0-552c-40d4-8f52-024d4913a56f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:01.095936 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-058852b0-552c-40d4-8f52-024d4913a56f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:01.096361 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-058852b0-552c-40d4-8f52-024d4913a56f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:01.126013 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-058852b0-552c-40d4-8f52-024d4913a56f tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047321 Sep 05 12:30:01.126565 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 489/965] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:30:01 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:30:01.190186 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-35d1c420-d75b-499f-81e6-c2943b156090 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:01.190715 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-35d1c420-d75b-499f-81e6-c2943b156090 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:01.197314 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-35d1c420-d75b-499f-81e6-c2943b156090 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:01.197783 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-35d1c420-d75b-499f-81e6-c2943b156090 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:01.198226 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-35d1c420-d75b-499f-81e6-c2943b156090 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:01.199137 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-35d1c420-d75b-499f-81e6-c2943b156090 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:01.199364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-35d1c420-d75b-499f-81e6-c2943b156090 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:01.199824 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-35d1c420-d75b-499f-81e6-c2943b156090 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:01.226175 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-35d1c420-d75b-499f-81e6-c2943b156090 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Going to try to terminate instance {{(pid=120534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:30:01.302712 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-35d1c420-d75b-499f-81e6-c2943b156090 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 204 len: 0 microversion: 2.1 time: 0.115959 Sep 05 12:30:01.303636 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 477/966] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:30:01 2022] DELETE /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:30:01.312005 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d58ea43e-6903-49a5-8740-841bce32fb2e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:01.312614 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d58ea43e-6903-49a5-8740-841bce32fb2e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:01.318499 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d58ea43e-6903-49a5-8740-841bce32fb2e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:01.318977 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d58ea43e-6903-49a5-8740-841bce32fb2e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:01.319411 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d58ea43e-6903-49a5-8740-841bce32fb2e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:01.320129 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d58ea43e-6903-49a5-8740-841bce32fb2e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:01.320582 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d58ea43e-6903-49a5-8740-841bce32fb2e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:01.321007 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d58ea43e-6903-49a5-8740-841bce32fb2e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:01.449320 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d58ea43e-6903-49a5-8740-841bce32fb2e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:01.457689 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d58ea43e-6903-49a5-8740-841bce32fb2e tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1671 microversion: 2.1 time: 0.149557 Sep 05 12:30:01.458256 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 490/967] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:01 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:02.482413 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-771d1254-5b62-4b05-9592-7dcfc26f64fa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:02.483108 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-771d1254-5b62-4b05-9592-7dcfc26f64fa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:02.489571 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-771d1254-5b62-4b05-9592-7dcfc26f64fa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:02.490052 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-771d1254-5b62-4b05-9592-7dcfc26f64fa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:02.490491 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-771d1254-5b62-4b05-9592-7dcfc26f64fa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:02.491190 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-771d1254-5b62-4b05-9592-7dcfc26f64fa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:02.491682 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-771d1254-5b62-4b05-9592-7dcfc26f64fa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:02.492116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-771d1254-5b62-4b05-9592-7dcfc26f64fa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:02.623832 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-771d1254-5b62-4b05-9592-7dcfc26f64fa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:02.632167 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-771d1254-5b62-4b05-9592-7dcfc26f64fa tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1671 microversion: 2.1 time: 0.153911 Sep 05 12:30:02.632670 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 478/968] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:02 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:03.657103 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c8eb66da-26ba-41ec-a24a-08e1fd0931b6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:03.657725 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c8eb66da-26ba-41ec-a24a-08e1fd0931b6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:03.664367 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c8eb66da-26ba-41ec-a24a-08e1fd0931b6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:03.664854 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c8eb66da-26ba-41ec-a24a-08e1fd0931b6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:03.665293 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c8eb66da-26ba-41ec-a24a-08e1fd0931b6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:03.665991 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c8eb66da-26ba-41ec-a24a-08e1fd0931b6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:03.666450 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c8eb66da-26ba-41ec-a24a-08e1fd0931b6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:03.666877 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c8eb66da-26ba-41ec-a24a-08e1fd0931b6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:04.149511 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c8eb66da-26ba-41ec-a24a-08e1fd0931b6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:04.157919 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c8eb66da-26ba-41ec-a24a-08e1fd0931b6 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1671 microversion: 2.1 time: 0.505131 Sep 05 12:30:04.158688 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 491/969] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:03 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1671 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:05.016534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-c241a802-2de0-431c-ac37-042c7db53055 req-bef179c8-2861-41b5-88e9-7ccde4920ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "887dcf0e-194f-41f2-bfa6-5e8e41fc24f6", "name": "network-vif-deleted", "tag": "fb563ae1-134e-4704-a744-d3c52eb2c338"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:05.026640 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-c241a802-2de0-431c-ac37-042c7db53055 req-bef179c8-2861-41b5-88e9-7ccde4920ddc service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:05.027132 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-c241a802-2de0-431c-ac37-042c7db53055 req-bef179c8-2861-41b5-88e9-7ccde4920ddc service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:05.027588 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-c241a802-2de0-431c-ac37-042c7db53055 req-bef179c8-2861-41b5-88e9-7ccde4920ddc service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:05.039379 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-c241a802-2de0-431c-ac37-042c7db53055 req-bef179c8-2861-41b5-88e9-7ccde4920ddc service nova] Creating event network-vif-deleted:fb563ae1-134e-4704-a744-d3c52eb2c338 for instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 on hv-cinder-85518 Sep 05 12:30:05.044271 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-c241a802-2de0-431c-ac37-042c7db53055 req-bef179c8-2861-41b5-88e9-7ccde4920ddc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278807 Sep 05 12:30:05.048556 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 479/970] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:05.180956 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d47578a9-f3f7-4523-8ecb-4b7d4a050d77 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:05.181553 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d47578a9-f3f7-4523-8ecb-4b7d4a050d77 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:05.188700 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d47578a9-f3f7-4523-8ecb-4b7d4a050d77 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:05.189185 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d47578a9-f3f7-4523-8ecb-4b7d4a050d77 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:05.189623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d47578a9-f3f7-4523-8ecb-4b7d4a050d77 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:05.190324 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d47578a9-f3f7-4523-8ecb-4b7d4a050d77 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:05.190800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d47578a9-f3f7-4523-8ecb-4b7d4a050d77 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:05.191230 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d47578a9-f3f7-4523-8ecb-4b7d4a050d77 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:05.225788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d47578a9-f3f7-4523-8ecb-4b7d4a050d77 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:05.226281 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d47578a9-f3f7-4523-8ecb-4b7d4a050d77 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:05.226721 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d47578a9-f3f7-4523-8ecb-4b7d4a050d77 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:05.227205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-d47578a9-f3f7-4523-8ecb-4b7d4a050d77 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lazy-loading 'fault' on Instance uuid 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:30:05.272234 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d47578a9-f3f7-4523-8ecb-4b7d4a050d77 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bd61574c6c4ebb9d6fe0c87228065f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f21d577dc6d44a7b05ee0a0232bed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:05.280263 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d47578a9-f3f7-4523-8ecb-4b7d4a050d77 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 200 len: 1326 microversion: 2.1 time: 0.103283 Sep 05 12:30:05.280876 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 492/971] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:05 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 1326 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:06.304475 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5617f83a-833c-4dfe-9d91-c4f7155e8733 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:06.305180 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5617f83a-833c-4dfe-9d91-c4f7155e8733 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:06.311336 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5617f83a-833c-4dfe-9d91-c4f7155e8733 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:06.311867 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5617f83a-833c-4dfe-9d91-c4f7155e8733 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:06.312306 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5617f83a-833c-4dfe-9d91-c4f7155e8733 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:06.312997 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5617f83a-833c-4dfe-9d91-c4f7155e8733 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:06.313459 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5617f83a-833c-4dfe-9d91-c4f7155e8733 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:06.313891 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5617f83a-833c-4dfe-9d91-c4f7155e8733 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:06.326918 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-5617f83a-833c-4dfe-9d91-c4f7155e8733 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] HTTP exception thrown: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5617f83a-833c-4dfe-9d91-c4f7155e8733 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Request method failure captured: Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 HTTP/1.1 Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFek5WORsXLudpQ0z6oCEAL-sJ8JqLDJQTDN2Jbg2D5DgFRQefamcZqj3pUvijm9sZEZ9Y_qSVRGehIFsemBFqG4MBNma5scm6u2ndD2iDYnQQgWsHgSv9O7PHEvwX2HK08452P96EQby2qocan4B1On-pr39CyyrGFeMpsV99E-5Rs0 Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 8f21d577dc6d44a7b05ee0a0232bed6c Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:30:06.329045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:30:06.330689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f21d577dc6d44a7b05ee0a0232bed6c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f21d577dc6d44a7b05ee0a0232bed6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f21d577dc6d44a7b05ee0a0232bed6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f21d577dc6d44a7b05ee0a0232bed6c"}]}] Sep 05 12:30:06.330689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:06.330689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 8f21d577dc6d44a7b05ee0a0232bed6c Sep 05 12:30:06.330689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:06.330689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-AttachVolumeTestJSON-656335981-project Sep 05 12:30:06.330689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:30:06.330689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:30:06.330689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 45bd61574c6c4ebb9d6fe0c87228065f Sep 05 12:30:06.330689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-AttachVolumeTestJSON-656335981-project Sep 05 12:30:06.330689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:30:06.330689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:06.330689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '887dcf0e-194f-41f2-bfa6-5e8e41fc24f6'} Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:30:06.331672 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:06.333293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:06.334686 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5617f83a-833c-4dfe-9d91-c4f7155e8733 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Returning 404 to user: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:30:06.334686 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5617f83a-833c-4dfe-9d91-c4f7155e8733 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 404 len: 111 microversion: 2.1 time: 0.030725 Sep 05 12:30:06.334686 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 480/972] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:06 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:30:06.339274 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b5a425a2-a9b9-4450-908d-a2e492dc4e36 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '.version_select at 0x7fba4b962940>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:06.358379 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b5a425a2-a9b9-4450-908d-a2e492dc4e36 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-402053730" status: 202 len: 0 microversion: 2.1 time: 0.022848 Sep 05 12:30:06.358932 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 493/973] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Sep 5 12:30:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-402053730 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:30:09.238230 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-62199923-bac9-4340-9997-c81974c529ba tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:09.238730 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-62199923-bac9-4340-9997-c81974c529ba tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:09.245343 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-62199923-bac9-4340-9997-c81974c529ba tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:09.245834 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-62199923-bac9-4340-9997-c81974c529ba tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:09.246279 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-62199923-bac9-4340-9997-c81974c529ba tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:09.246980 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-62199923-bac9-4340-9997-c81974c529ba tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:09.247439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-62199923-bac9-4340-9997-c81974c529ba tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:09.247928 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-62199923-bac9-4340-9997-c81974c529ba tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:09.263213 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-62199923-bac9-4340-9997-c81974c529ba tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] HTTP exception thrown: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-62199923-bac9-4340-9997-c81974c529ba tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Request method failure captured: Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: DELETE /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 HTTP/1.1 Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFek5WORsXLudpQ0z6oCEAL-sJ8JqLDJQTDN2Jbg2D5DgFRQefamcZqj3pUvijm9sZEZ9Y_qSVRGehIFsemBFqG4MBNma5scm6u2ndD2iDYnQQgWsHgSv9O7PHEvwX2HK08452P96EQby2qocan4B1On-pr39CyyrGFeMpsV99E-5Rs0 Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 8f21d577dc6d44a7b05ee0a0232bed6c Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:30:09.264790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:30:09.266778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f21d577dc6d44a7b05ee0a0232bed6c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f21d577dc6d44a7b05ee0a0232bed6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f21d577dc6d44a7b05ee0a0232bed6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f21d577dc6d44a7b05ee0a0232bed6c"}]}] Sep 05 12:30:09.266778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:09.266778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 8f21d577dc6d44a7b05ee0a0232bed6c Sep 05 12:30:09.266778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:09.266778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-AttachVolumeTestJSON-656335981-project Sep 05 12:30:09.266778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:30:09.266778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:30:09.266778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 45bd61574c6c4ebb9d6fe0c87228065f Sep 05 12:30:09.266778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-AttachVolumeTestJSON-656335981-project Sep 05 12:30:09.266778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:30:09.266778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:09.266778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '887dcf0e-194f-41f2-bfa6-5e8e41fc24f6'} Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:30:09.267665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:09.269130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:09.270572 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-62199923-bac9-4340-9997-c81974c529ba tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Returning 404 to user: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:30:09.270572 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-62199923-bac9-4340-9997-c81974c529ba tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 404 len: 111 microversion: 2.1 time: 0.032361 Sep 05 12:30:09.270572 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 481/974] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:30:09 2022] DELETE /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:30:09.276100 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2d5c36fc-6e86-4f5b-9a5c-db78dedf7da0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:09.276973 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2d5c36fc-6e86-4f5b-9a5c-db78dedf7da0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:09.284195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d5c36fc-6e86-4f5b-9a5c-db78dedf7da0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:09.284678 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d5c36fc-6e86-4f5b-9a5c-db78dedf7da0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:09.285117 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d5c36fc-6e86-4f5b-9a5c-db78dedf7da0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:09.285808 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d5c36fc-6e86-4f5b-9a5c-db78dedf7da0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:09.286267 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d5c36fc-6e86-4f5b-9a5c-db78dedf7da0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:09.286697 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2d5c36fc-6e86-4f5b-9a5c-db78dedf7da0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:09.299926 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-2d5c36fc-6e86-4f5b-9a5c-db78dedf7da0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] HTTP exception thrown: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2d5c36fc-6e86-4f5b-9a5c-db78dedf7da0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Request method failure captured: Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 HTTP/1.1 Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFek5WORsXLudpQ0z6oCEAL-sJ8JqLDJQTDN2Jbg2D5DgFRQefamcZqj3pUvijm9sZEZ9Y_qSVRGehIFsemBFqG4MBNma5scm6u2ndD2iDYnQQgWsHgSv9O7PHEvwX2HK08452P96EQby2qocan4B1On-pr39CyyrGFeMpsV99E-5Rs0 Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 8f21d577dc6d44a7b05ee0a0232bed6c Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:30:09.301575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:30:09.303238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f21d577dc6d44a7b05ee0a0232bed6c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f21d577dc6d44a7b05ee0a0232bed6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f21d577dc6d44a7b05ee0a0232bed6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f21d577dc6d44a7b05ee0a0232bed6c"}]}] Sep 05 12:30:09.303238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:09.303238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 8f21d577dc6d44a7b05ee0a0232bed6c Sep 05 12:30:09.303238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:09.303238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-AttachVolumeTestJSON-656335981-project Sep 05 12:30:09.303238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:30:09.303238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:30:09.303238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: 45bd61574c6c4ebb9d6fe0c87228065f Sep 05 12:30:09.303238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-AttachVolumeTestJSON-656335981-project Sep 05 12:30:09.303238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:30:09.303238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:09.303238 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '887dcf0e-194f-41f2-bfa6-5e8e41fc24f6'} Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:30:09.304186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. Sep 05 12:30:09.305716 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:09.307117 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2d5c36fc-6e86-4f5b-9a5c-db78dedf7da0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Returning 404 to user: Instance 887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:30:09.307117 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2d5c36fc-6e86-4f5b-9a5c-db78dedf7da0 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6" status: 404 len: 111 microversion: 2.1 time: 0.031575 Sep 05 12:30:09.307117 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 494/975] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:09 2022] GET /compute/v2.1/servers/887dcf0e-194f-41f2-bfa6-5e8e41fc24f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:30:10.446419 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d2d273ba-5fb5-40b5-b40e-c4c55b6be58d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:10.446916 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d2d273ba-5fb5-40b5-b40e-c4c55b6be58d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:10.453774 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d2d273ba-5fb5-40b5-b40e-c4c55b6be58d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:10.454249 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d2d273ba-5fb5-40b5-b40e-c4c55b6be58d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:10.454678 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d2d273ba-5fb5-40b5-b40e-c4c55b6be58d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:10.455358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d2d273ba-5fb5-40b5-b40e-c4c55b6be58d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:10.455838 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d2d273ba-5fb5-40b5-b40e-c4c55b6be58d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:10.456257 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d2d273ba-5fb5-40b5-b40e-c4c55b6be58d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:10.470056 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-d2d273ba-5fb5-40b5-b40e-c4c55b6be58d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] HTTP exception thrown: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d2d273ba-5fb5-40b5-b40e-c4c55b6be58d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Request method failure captured: Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: DELETE /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 HTTP/1.1 Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFek5WORsXLudpQ0z6oCEAL-sJ8JqLDJQTDN2Jbg2D5DgFRQefamcZqj3pUvijm9sZEZ9Y_qSVRGehIFsemBFqG4MBNma5scm6u2ndD2iDYnQQgWsHgSv9O7PHEvwX2HK08452P96EQby2qocan4B1On-pr39CyyrGFeMpsV99E-5Rs0 Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 8f21d577dc6d44a7b05ee0a0232bed6c Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:30:10.471652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:30:10.473449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f21d577dc6d44a7b05ee0a0232bed6c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f21d577dc6d44a7b05ee0a0232bed6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f21d577dc6d44a7b05ee0a0232bed6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f21d577dc6d44a7b05ee0a0232bed6c"}]}] Sep 05 12:30:10.473449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:10.473449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 8f21d577dc6d44a7b05ee0a0232bed6c Sep 05 12:30:10.473449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:10.473449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-AttachVolumeTestJSON-656335981-project Sep 05 12:30:10.473449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:30:10.473449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:30:10.473449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 45bd61574c6c4ebb9d6fe0c87228065f Sep 05 12:30:10.473449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-AttachVolumeTestJSON-656335981-project Sep 05 12:30:10.473449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:30:10.473449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:30:10.473449 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': 'b78eb7b3-fb70-404b-b598-c80dd26f2827'} Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:30:10.474534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:30:10.476322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:10.478086 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d2d273ba-5fb5-40b5-b40e-c4c55b6be58d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Returning 404 to user: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:30:10.478086 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d2d273ba-5fb5-40b5-b40e-c4c55b6be58d tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 404 len: 111 microversion: 2.1 time: 0.030427 Sep 05 12:30:10.478086 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 482/976] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:30:10 2022] DELETE /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:30:10.481292 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-98f1887f-c2b5-49f0-a7e5-a9fe5bccd2c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:10.481900 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-98f1887f-c2b5-49f0-a7e5-a9fe5bccd2c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] [instance: b78eb7b3-fb70-404b-b598-c80dd26f2827] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:10.488303 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98f1887f-c2b5-49f0-a7e5-a9fe5bccd2c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:10.488782 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98f1887f-c2b5-49f0-a7e5-a9fe5bccd2c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:10.489219 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98f1887f-c2b5-49f0-a7e5-a9fe5bccd2c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:10.489900 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98f1887f-c2b5-49f0-a7e5-a9fe5bccd2c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:10.490347 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98f1887f-c2b5-49f0-a7e5-a9fe5bccd2c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:10.490763 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-98f1887f-c2b5-49f0-a7e5-a9fe5bccd2c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:10.505250 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-98f1887f-c2b5-49f0-a7e5-a9fe5bccd2c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] HTTP exception thrown: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-98f1887f-c2b5-49f0-a7e5-a9fe5bccd2c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Request method failure captured: Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 HTTP/1.1 Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFek5WORsXLudpQ0z6oCEAL-sJ8JqLDJQTDN2Jbg2D5DgFRQefamcZqj3pUvijm9sZEZ9Y_qSVRGehIFsemBFqG4MBNma5scm6u2ndD2iDYnQQgWsHgSv9O7PHEvwX2HK08452P96EQby2qocan4B1On-pr39CyyrGFeMpsV99E-5Rs0 Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 8f21d577dc6d44a7b05ee0a0232bed6c Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:30:10.506769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:30:10.508428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f21d577dc6d44a7b05ee0a0232bed6c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f21d577dc6d44a7b05ee0a0232bed6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f21d577dc6d44a7b05ee0a0232bed6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f21d577dc6d44a7b05ee0a0232bed6c"}]}] Sep 05 12:30:10.508428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:10.508428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 8f21d577dc6d44a7b05ee0a0232bed6c Sep 05 12:30:10.508428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-AttachVolumeTestJSON-656335981 Sep 05 12:30:10.508428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-AttachVolumeTestJSON-656335981-project Sep 05 12:30:10.508428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:30:10.508428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:30:10.508428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: 45bd61574c6c4ebb9d6fe0c87228065f Sep 05 12:30:10.508428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-AttachVolumeTestJSON-656335981-project Sep 05 12:30:10.508428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:30:10.508428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:30:10.508428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': 'b78eb7b3-fb70-404b-b598-c80dd26f2827'} Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:30:10.509358 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. Sep 05 12:30:10.510828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:10.512203 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-98f1887f-c2b5-49f0-a7e5-a9fe5bccd2c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] Returning 404 to user: Instance b78eb7b3-fb70-404b-b598-c80dd26f2827 could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:30:10.512203 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-98f1887f-c2b5-49f0-a7e5-a9fe5bccd2c1 tempest-AttachVolumeTestJSON-656335981 tempest-AttachVolumeTestJSON-656335981-project] 10.222.0.16 "GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827" status: 404 len: 111 microversion: 2.1 time: 0.030651 Sep 05 12:30:10.512203 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 495/977] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:10 2022] GET /compute/v2.1/servers/b78eb7b3-fb70-404b-b598-c80dd26f2827 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:30:19.281791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5c778d82-c2e1-404e-b41a-795b00989ea2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Action: 'create', calling method: .version_select at 0x7fba4b741040>, body: {"keypair": {"name": "tempest-keypair-1300991841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE75K8zeG8fY7J5ItRUFkEXWA4TOQi52UKtzXnpTZHcDPoLu3nC7wJvdYWwCOIzyYLyuHq/O5OlqfaI/dDuMT4sUVz8GgAc4HpuRU12YVXc4tYuIvsQdd5b9wXtLiGDPKg=="}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:19.302348 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-5c778d82-c2e1-404e-b41a-795b00989ea2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'key_pairs'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:30:19.306802 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-5c778d82-c2e1-404e-b41a-795b00989ea2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for user ee580cfc10dd4536b0709e65e3d23d4d and project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'key_pairs'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:30:19.334851 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5c778d82-c2e1-404e-b41a-795b00989ea2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194380 Sep 05 12:30:19.335456 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 483/978] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Sep 5 12:30:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:20.693874 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1381536514", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49732eeb-e082-4048-831f-1af5d3375981"}], "security_groups": [{"name": "tempest-securitygroup--861662002"}], "key_name": "tempest-keypair-1300991841", "user_data": "}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:20.703335 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:20.704401 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:20.819597 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.network.neutron [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] validate_networks() for [('49732eeb-e082-4048-831f-1af5d3375981', None, None, None, None, None)] {{(pid=120535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:30:21.315984 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Flavor limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:30:21.321647 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Image limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:30:21.322735 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Flavor pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:30:21.323378 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Image pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:30:21.324058 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:30:21.335120 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:21.335971 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:21.336653 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:21.337612 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:21.338301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:21.338960 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:21.361139 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:30:21.366205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for user ee580cfc10dd4536b0709e65e3d23d4d and project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:30:21.388714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Going to run 1 instances... {{(pid=120535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:30:21.391348 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:30:21.448733 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4aa77d2c-fe63-4d7d-81e6-85b9dfbb3197 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.760516 Sep 05 12:30:21.456255 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 496/979] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:30:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:30:21.458716 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:21.463335 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8b3839e1-a0e5-458d-81a8-f06861a6c06d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:21.464289 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-8b3839e1-a0e5-458d-81a8-f06861a6c06d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:21.538986 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8b3839e1-a0e5-458d-81a8-f06861a6c06d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:21.547075 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8b3839e1-a0e5-458d-81a8-f06861a6c06d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1242 microversion: 2.1 time: 0.089006 Sep 05 12:30:21.548919 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 484/980] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:21 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:22.572042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a3a46f53-e7ce-4bf0-bf9e-1cdd94fd5d98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:22.572889 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a3a46f53-e7ce-4bf0-bf9e-1cdd94fd5d98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:22.579334 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a3a46f53-e7ce-4bf0-bf9e-1cdd94fd5d98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:22.579940 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a3a46f53-e7ce-4bf0-bf9e-1cdd94fd5d98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:22.580457 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a3a46f53-e7ce-4bf0-bf9e-1cdd94fd5d98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:22.581250 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a3a46f53-e7ce-4bf0-bf9e-1cdd94fd5d98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:22.581782 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a3a46f53-e7ce-4bf0-bf9e-1cdd94fd5d98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:22.582281 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a3a46f53-e7ce-4bf0-bf9e-1cdd94fd5d98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:22.647277 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a3a46f53-e7ce-4bf0-bf9e-1cdd94fd5d98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:22.655504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a3a46f53-e7ce-4bf0-bf9e-1cdd94fd5d98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1294 microversion: 2.1 time: 0.087873 Sep 05 12:30:22.656106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 497/981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:22 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:23.683778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-36827374-20e5-4863-aea7-a4f7c310b840 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:23.685072 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-36827374-20e5-4863-aea7-a4f7c310b840 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:23.692537 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-36827374-20e5-4863-aea7-a4f7c310b840 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:23.693115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-36827374-20e5-4863-aea7-a4f7c310b840 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:23.693708 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-36827374-20e5-4863-aea7-a4f7c310b840 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:23.694469 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-36827374-20e5-4863-aea7-a4f7c310b840 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:23.695013 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-36827374-20e5-4863-aea7-a4f7c310b840 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:23.695855 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-36827374-20e5-4863-aea7-a4f7c310b840 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:23.864050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-36827374-20e5-4863-aea7-a4f7c310b840 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:23.871745 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-36827374-20e5-4863-aea7-a4f7c310b840 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1367 microversion: 2.1 time: 0.196660 Sep 05 12:30:23.872323 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 485/982] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:23 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:24.723567 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-fea2fc56-0ef2-4f2f-a32a-a6300c1c17de req-558f0313-aced-4182-a337-d53698b63a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c2c88ae-7231-41ce-89c5-c82c379fd3ca", "tag": "f195a195-8eca-4b03-b45b-5519e70a504a"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:24.735984 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-fea2fc56-0ef2-4f2f-a32a-a6300c1c17de req-558f0313-aced-4182-a337-d53698b63a99 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:24.736933 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-fea2fc56-0ef2-4f2f-a32a-a6300c1c17de req-558f0313-aced-4182-a337-d53698b63a99 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:24.737438 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-fea2fc56-0ef2-4f2f-a32a-a6300c1c17de req-558f0313-aced-4182-a337-d53698b63a99 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:24.749771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-fea2fc56-0ef2-4f2f-a32a-a6300c1c17de req-558f0313-aced-4182-a337-d53698b63a99 service nova] Creating event network-changed:f195a195-8eca-4b03-b45b-5519e70a504a for instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca on hv-cinder-85518 Sep 05 12:30:24.755731 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-fea2fc56-0ef2-4f2f-a32a-a6300c1c17de req-558f0313-aced-4182-a337-d53698b63a99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037476 Sep 05 12:30:24.757298 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 498/983] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:24.894847 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-51cff646-5bdf-4309-9684-632efbea505f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:24.895399 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-51cff646-5bdf-4309-9684-632efbea505f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:24.902093 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51cff646-5bdf-4309-9684-632efbea505f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:24.902581 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51cff646-5bdf-4309-9684-632efbea505f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:24.903023 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51cff646-5bdf-4309-9684-632efbea505f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:24.903749 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51cff646-5bdf-4309-9684-632efbea505f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:24.904210 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51cff646-5bdf-4309-9684-632efbea505f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:24.904778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-51cff646-5bdf-4309-9684-632efbea505f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:25.035137 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-51cff646-5bdf-4309-9684-632efbea505f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:25.043040 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-51cff646-5bdf-4309-9684-632efbea505f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1367 microversion: 2.1 time: 0.152124 Sep 05 12:30:25.043616 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 486/984] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:24 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:26.066102 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-adb594fa-a2f2-41a8-9ae7-56962eece9ae tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:26.066808 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-adb594fa-a2f2-41a8-9ae7-56962eece9ae tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:26.073694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-adb594fa-a2f2-41a8-9ae7-56962eece9ae tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:26.074180 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-adb594fa-a2f2-41a8-9ae7-56962eece9ae tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:26.074606 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-adb594fa-a2f2-41a8-9ae7-56962eece9ae tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:26.075300 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-adb594fa-a2f2-41a8-9ae7-56962eece9ae tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:26.075773 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-adb594fa-a2f2-41a8-9ae7-56962eece9ae tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:26.076199 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-adb594fa-a2f2-41a8-9ae7-56962eece9ae tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:26.204787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-adb594fa-a2f2-41a8-9ae7-56962eece9ae tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:26.212420 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-adb594fa-a2f2-41a8-9ae7-56962eece9ae tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1367 microversion: 2.1 time: 0.150506 Sep 05 12:30:26.213179 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 499/985] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:26 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:27.237722 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-250824b4-b4bd-4afa-aa15-b6c34660ebda tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:27.238329 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-250824b4-b4bd-4afa-aa15-b6c34660ebda tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:27.244539 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-250824b4-b4bd-4afa-aa15-b6c34660ebda tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:27.245014 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-250824b4-b4bd-4afa-aa15-b6c34660ebda tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:27.245673 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-250824b4-b4bd-4afa-aa15-b6c34660ebda tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:27.246370 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-250824b4-b4bd-4afa-aa15-b6c34660ebda tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:27.246831 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-250824b4-b4bd-4afa-aa15-b6c34660ebda tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:27.247246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-250824b4-b4bd-4afa-aa15-b6c34660ebda tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:27.378894 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-250824b4-b4bd-4afa-aa15-b6c34660ebda tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:27.386793 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-250824b4-b4bd-4afa-aa15-b6c34660ebda tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1367 microversion: 2.1 time: 0.153470 Sep 05 12:30:27.387369 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 487/986] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:27 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:28.410740 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-763b31ee-7976-434c-b8d8-cf2048ffa82c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:28.411355 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-763b31ee-7976-434c-b8d8-cf2048ffa82c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:28.417775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-763b31ee-7976-434c-b8d8-cf2048ffa82c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:28.418256 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-763b31ee-7976-434c-b8d8-cf2048ffa82c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:28.418690 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-763b31ee-7976-434c-b8d8-cf2048ffa82c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:28.419382 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-763b31ee-7976-434c-b8d8-cf2048ffa82c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:28.419917 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-763b31ee-7976-434c-b8d8-cf2048ffa82c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:28.420289 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-763b31ee-7976-434c-b8d8-cf2048ffa82c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:28.555923 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-763b31ee-7976-434c-b8d8-cf2048ffa82c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:28.564264 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-763b31ee-7976-434c-b8d8-cf2048ffa82c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1367 microversion: 2.1 time: 0.158099 Sep 05 12:30:28.564822 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 500/987] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:28 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:29.586225 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-977fbf2d-206d-43e9-9496-2c1eae7a6c85 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:29.586835 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-977fbf2d-206d-43e9-9496-2c1eae7a6c85 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:29.589270 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:29.595327 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-977fbf2d-206d-43e9-9496-2c1eae7a6c85 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:29.595845 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-977fbf2d-206d-43e9-9496-2c1eae7a6c85 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:29.596519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-977fbf2d-206d-43e9-9496-2c1eae7a6c85 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:29.597226 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-977fbf2d-206d-43e9-9496-2c1eae7a6c85 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:29.597687 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-977fbf2d-206d-43e9-9496-2c1eae7a6c85 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:29.598118 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-977fbf2d-206d-43e9-9496-2c1eae7a6c85 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:29.732650 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-977fbf2d-206d-43e9-9496-2c1eae7a6c85 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:29.740300 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-977fbf2d-206d-43e9-9496-2c1eae7a6c85 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1367 microversion: 2.1 time: 0.157936 Sep 05 12:30:29.740865 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 488/988] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:29 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:30:30.764183 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f469bdcd-3fbf-443e-bcc0-c8f1a6ab64bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:30.764812 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f469bdcd-3fbf-443e-bcc0-c8f1a6ab64bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:30.771775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f469bdcd-3fbf-443e-bcc0-c8f1a6ab64bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:30.772258 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f469bdcd-3fbf-443e-bcc0-c8f1a6ab64bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:30.772688 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f469bdcd-3fbf-443e-bcc0-c8f1a6ab64bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:30.773451 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f469bdcd-3fbf-443e-bcc0-c8f1a6ab64bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:30.773899 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f469bdcd-3fbf-443e-bcc0-c8f1a6ab64bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:30.774461 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f469bdcd-3fbf-443e-bcc0-c8f1a6ab64bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:30.903074 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f469bdcd-3fbf-443e-bcc0-c8f1a6ab64bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:30.911738 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f469bdcd-3fbf-443e-bcc0-c8f1a6ab64bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1367 microversion: 2.1 time: 0.151478 Sep 05 12:30:30.912431 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 501/989] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:30 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:31.094136 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-280e43a8-d2dc-4609-9997-139ef7fc5baa req-facf1056-54cd-40f3-8157-0f16375502c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2c88ae-7231-41ce-89c5-c82c379fd3ca", "name": "network-vif-plugged", "status": "completed", "tag": "f195a195-8eca-4b03-b45b-5519e70a504a"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:31.103696 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-280e43a8-d2dc-4609-9997-139ef7fc5baa req-facf1056-54cd-40f3-8157-0f16375502c5 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:31.104173 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-280e43a8-d2dc-4609-9997-139ef7fc5baa req-facf1056-54cd-40f3-8157-0f16375502c5 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:31.104599 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-280e43a8-d2dc-4609-9997-139ef7fc5baa req-facf1056-54cd-40f3-8157-0f16375502c5 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:31.115433 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-280e43a8-d2dc-4609-9997-139ef7fc5baa req-facf1056-54cd-40f3-8157-0f16375502c5 service nova] Creating event network-vif-plugged:f195a195-8eca-4b03-b45b-5519e70a504a for instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca on hv-cinder-85518 Sep 05 12:30:31.120315 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-280e43a8-d2dc-4609-9997-139ef7fc5baa req-facf1056-54cd-40f3-8157-0f16375502c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089575 Sep 05 12:30:31.120884 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 489/990] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:31.934381 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-662ed60f-cc5b-4609-b862-1ce95c622be5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:31.934936 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-662ed60f-cc5b-4609-b862-1ce95c622be5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:31.936885 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:31.938034 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=6 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:31.944099 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-662ed60f-cc5b-4609-b862-1ce95c622be5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:31.944580 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-662ed60f-cc5b-4609-b862-1ce95c622be5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:31.945014 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-662ed60f-cc5b-4609-b862-1ce95c622be5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:31.945701 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-662ed60f-cc5b-4609-b862-1ce95c622be5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:31.946159 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-662ed60f-cc5b-4609-b862-1ce95c622be5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:31.946581 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-662ed60f-cc5b-4609-b862-1ce95c622be5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:32.078378 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-662ed60f-cc5b-4609-b862-1ce95c622be5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:32.085978 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-662ed60f-cc5b-4609-b862-1ce95c622be5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1367 microversion: 2.1 time: 0.155602 Sep 05 12:30:32.086536 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 502/991] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:31 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:33.105275 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=6 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:33.110146 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-97ea258a-71da-4a0f-9d37-4919ece60cba tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:33.110843 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-97ea258a-71da-4a0f-9d37-4919ece60cba tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:33.118560 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-97ea258a-71da-4a0f-9d37-4919ece60cba tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:33.119046 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-97ea258a-71da-4a0f-9d37-4919ece60cba tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:33.119486 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-97ea258a-71da-4a0f-9d37-4919ece60cba tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:33.120250 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-97ea258a-71da-4a0f-9d37-4919ece60cba tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:33.120705 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-97ea258a-71da-4a0f-9d37-4919ece60cba tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:33.121131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-97ea258a-71da-4a0f-9d37-4919ece60cba tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:33.263314 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-97ea258a-71da-4a0f-9d37-4919ece60cba tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:33.273315 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-97ea258a-71da-4a0f-9d37-4919ece60cba tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1367 microversion: 2.1 time: 0.168897 Sep 05 12:30:33.273891 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 490/992] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:33 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:34.296496 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-046c21e9-bdfe-4ff7-8cd3-3c0bfb8672a4 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:34.297240 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-046c21e9-bdfe-4ff7-8cd3-3c0bfb8672a4 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:34.304875 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-046c21e9-bdfe-4ff7-8cd3-3c0bfb8672a4 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:34.305356 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-046c21e9-bdfe-4ff7-8cd3-3c0bfb8672a4 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:34.305800 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-046c21e9-bdfe-4ff7-8cd3-3c0bfb8672a4 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:34.306495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-046c21e9-bdfe-4ff7-8cd3-3c0bfb8672a4 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:34.306945 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-046c21e9-bdfe-4ff7-8cd3-3c0bfb8672a4 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:34.307368 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-046c21e9-bdfe-4ff7-8cd3-3c0bfb8672a4 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:34.436810 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-046c21e9-bdfe-4ff7-8cd3-3c0bfb8672a4 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:34.445042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-046c21e9-bdfe-4ff7-8cd3-3c0bfb8672a4 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1558 microversion: 2.1 time: 0.152485 Sep 05 12:30:34.445616 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 503/993] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:34 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:34.467328 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-3f569393-824e-47fa-a751-33d6b933c655 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:34.467892 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-3f569393-824e-47fa-a751-33d6b933c655 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:34.474827 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3f569393-824e-47fa-a751-33d6b933c655 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:34.475387 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3f569393-824e-47fa-a751-33d6b933c655 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:34.475885 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3f569393-824e-47fa-a751-33d6b933c655 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:34.476717 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3f569393-824e-47fa-a751-33d6b933c655 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:34.477172 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3f569393-824e-47fa-a751-33d6b933c655 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:34.477598 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-3f569393-824e-47fa-a751-33d6b933c655 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:34.555452 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-3f569393-824e-47fa-a751-33d6b933c655 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091883 Sep 05 12:30:34.556106 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 491/994] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Sep 5 12:30:34 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:35.484891 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-20d0a387-73cb-4976-ae82-3c9b17e82aed req-94d28535-005a-4e86-bcb3-2da4a2dea033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c2c88ae-7231-41ce-89c5-c82c379fd3ca", "tag": "f195a195-8eca-4b03-b45b-5519e70a504a"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:35.495318 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-20d0a387-73cb-4976-ae82-3c9b17e82aed req-94d28535-005a-4e86-bcb3-2da4a2dea033 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:35.495830 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-20d0a387-73cb-4976-ae82-3c9b17e82aed req-94d28535-005a-4e86-bcb3-2da4a2dea033 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:35.496451 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-20d0a387-73cb-4976-ae82-3c9b17e82aed req-94d28535-005a-4e86-bcb3-2da4a2dea033 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:35.509266 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-20d0a387-73cb-4976-ae82-3c9b17e82aed req-94d28535-005a-4e86-bcb3-2da4a2dea033 service nova] Creating event network-changed:f195a195-8eca-4b03-b45b-5519e70a504a for instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca on hv-cinder-85518 Sep 05 12:30:35.514292 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-20d0a387-73cb-4976-ae82-3c9b17e82aed req-94d28535-005a-4e86-bcb3-2da4a2dea033 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033058 Sep 05 12:30:35.514967 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 504/995] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:41.160559 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-060e3208-450a-4dfb-911f-b02abee4876a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:41.162936 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-060e3208-450a-4dfb-911f-b02abee4876a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:41.169205 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-060e3208-450a-4dfb-911f-b02abee4876a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:41.169767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-060e3208-450a-4dfb-911f-b02abee4876a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:41.170207 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-060e3208-450a-4dfb-911f-b02abee4876a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:41.170901 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-060e3208-450a-4dfb-911f-b02abee4876a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:41.171353 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-060e3208-450a-4dfb-911f-b02abee4876a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:41.171852 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-060e3208-450a-4dfb-911f-b02abee4876a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:41.203931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-060e3208-450a-4dfb-911f-b02abee4876a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047772 Sep 05 12:30:41.204807 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 492/996] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Sep 5 12:30:41 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:41.287933 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-43d9e176-9c01-4c47-a67a-0bbc23152987 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:41.288711 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-43d9e176-9c01-4c47-a67a-0bbc23152987 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:41.299981 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-43d9e176-9c01-4c47-a67a-0bbc23152987 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:41.300767 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-43d9e176-9c01-4c47-a67a-0bbc23152987 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:41.301234 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-43d9e176-9c01-4c47-a67a-0bbc23152987 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:41.302354 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-43d9e176-9c01-4c47-a67a-0bbc23152987 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:41.302932 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-43d9e176-9c01-4c47-a67a-0bbc23152987 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:41.303447 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-43d9e176-9c01-4c47-a67a-0bbc23152987 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:41.335905 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-43d9e176-9c01-4c47-a67a-0bbc23152987 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Going to try to terminate instance {{(pid=120535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:30:41.418151 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-43d9e176-9c01-4c47-a67a-0bbc23152987 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 204 len: 0 microversion: 2.20 time: 0.137683 Sep 05 12:30:41.418726 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 505/997] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Sep 5 12:30:41 2022] DELETE /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 05 12:30:41.428780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c8491cf2-5ef7-4624-9158-5b629511812e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:41.429442 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c8491cf2-5ef7-4624-9158-5b629511812e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:41.436444 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c8491cf2-5ef7-4624-9158-5b629511812e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:41.437027 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c8491cf2-5ef7-4624-9158-5b629511812e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:41.437474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c8491cf2-5ef7-4624-9158-5b629511812e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:41.438865 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c8491cf2-5ef7-4624-9158-5b629511812e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:41.439330 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c8491cf2-5ef7-4624-9158-5b629511812e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:41.439790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c8491cf2-5ef7-4624-9158-5b629511812e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:41.582709 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c8491cf2-5ef7-4624-9158-5b629511812e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:41.592779 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c8491cf2-5ef7-4624-9158-5b629511812e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:41.595110 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c8491cf2-5ef7-4624-9158-5b629511812e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:41.596460 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c8491cf2-5ef7-4624-9158-5b629511812e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1723 microversion: 2.20 time: 0.171932 Sep 05 12:30:41.597789 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 493/998] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:41 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:30:42.622811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ef8f801e-6692-40db-b3b4-336956d5b51a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:42.623509 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ef8f801e-6692-40db-b3b4-336956d5b51a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:42.630142 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef8f801e-6692-40db-b3b4-336956d5b51a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:42.630558 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef8f801e-6692-40db-b3b4-336956d5b51a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:42.630987 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef8f801e-6692-40db-b3b4-336956d5b51a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:42.631701 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef8f801e-6692-40db-b3b4-336956d5b51a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:42.632152 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef8f801e-6692-40db-b3b4-336956d5b51a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:42.632568 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ef8f801e-6692-40db-b3b4-336956d5b51a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:42.775727 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ef8f801e-6692-40db-b3b4-336956d5b51a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:42.785031 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ef8f801e-6692-40db-b3b4-336956d5b51a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:42.786461 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ef8f801e-6692-40db-b3b4-336956d5b51a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:42.787652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ef8f801e-6692-40db-b3b4-336956d5b51a tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1723 microversion: 2.20 time: 0.169088 Sep 05 12:30:42.788205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 506/999] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:42 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:30:43.812975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5a9eabc8-9aee-4753-96fe-2279907ea6f4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:43.813684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5a9eabc8-9aee-4753-96fe-2279907ea6f4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:43.821114 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5a9eabc8-9aee-4753-96fe-2279907ea6f4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:43.821602 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5a9eabc8-9aee-4753-96fe-2279907ea6f4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:43.822048 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5a9eabc8-9aee-4753-96fe-2279907ea6f4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:43.822740 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5a9eabc8-9aee-4753-96fe-2279907ea6f4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:43.823202 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5a9eabc8-9aee-4753-96fe-2279907ea6f4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:43.823752 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5a9eabc8-9aee-4753-96fe-2279907ea6f4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:43.899793 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5a9eabc8-9aee-4753-96fe-2279907ea6f4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:43.909568 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5a9eabc8-9aee-4753-96fe-2279907ea6f4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:43.911047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5a9eabc8-9aee-4753-96fe-2279907ea6f4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83d3b245c185424a9b6e5d69d691f031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5b70833b074d199437d3f10e511306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:43.912362 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5a9eabc8-9aee-4753-96fe-2279907ea6f4 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 200 len: 1655 microversion: 2.20 time: 0.103504 Sep 05 12:30:43.915581 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 494/1000] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:43 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 1655 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:30:44.232491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-7e8ad9ce-05bc-4146-9c95-d5449b901ea1 req-71632775-e45a-44ba-8708-e7d8d3b4a667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0055a73c-7732-48a3-b76b-3b8cc28e7804", "name": "network-vif-deleted", "tag": "a65b6d21-8474-43a9-bb2b-2b6a76c853f9"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:44.243261 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-7e8ad9ce-05bc-4146-9c95-d5449b901ea1 req-71632775-e45a-44ba-8708-e7d8d3b4a667 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:44.244072 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-7e8ad9ce-05bc-4146-9c95-d5449b901ea1 req-71632775-e45a-44ba-8708-e7d8d3b4a667 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:44.244581 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-7e8ad9ce-05bc-4146-9c95-d5449b901ea1 req-71632775-e45a-44ba-8708-e7d8d3b4a667 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:44.257829 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-7e8ad9ce-05bc-4146-9c95-d5449b901ea1 req-71632775-e45a-44ba-8708-e7d8d3b4a667 service nova] Creating event network-vif-deleted:a65b6d21-8474-43a9-bb2b-2b6a76c853f9 for instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 on hv-cinder-85518 Sep 05 12:30:44.262801 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-7e8ad9ce-05bc-4146-9c95-d5449b901ea1 req-71632775-e45a-44ba-8708-e7d8d3b4a667 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034368 Sep 05 12:30:44.263641 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 507/1001] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:44.939922 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-55726086-2bd4-4552-9de1-89f0b5898cb0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:44.940546 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-55726086-2bd4-4552-9de1-89f0b5898cb0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:44.948136 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-55726086-2bd4-4552-9de1-89f0b5898cb0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:44.948786 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-55726086-2bd4-4552-9de1-89f0b5898cb0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:44.949482 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-55726086-2bd4-4552-9de1-89f0b5898cb0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:44.950293 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-55726086-2bd4-4552-9de1-89f0b5898cb0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:44.952254 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-55726086-2bd4-4552-9de1-89f0b5898cb0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:44.953056 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-55726086-2bd4-4552-9de1-89f0b5898cb0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:44.969634 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-55726086-2bd4-4552-9de1-89f0b5898cb0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] HTTP exception thrown: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-55726086-2bd4-4552-9de1-89f0b5898cb0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Request method failure captured: Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 HTTP/1.1 Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFekrqRS_NwomMhQqkMVzqnYC2XXZ0Xu1LzWsEsn_xtvRm9kUL9JPxa3yIn1RdmyywzbOT0h0KK1MjXyms-gagh4KPikA3AhPAWq52mOpkm_qo_9hlivRRj93Ft7gaGshkOmAY7XWNDbqsZN0h93vMUX8NhVMq6Js8kBnRNTTiZifl_o Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: ca5b70833b074d199437d3f10e511306 Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:30:44.971457 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:30:44.973318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca5b70833b074d199437d3f10e511306", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca5b70833b074d199437d3f10e511306"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca5b70833b074d199437d3f10e511306"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca5b70833b074d199437d3f10e511306"}]}] Sep 05 12:30:44.973318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:44.973318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: ca5b70833b074d199437d3f10e511306 Sep 05 12:30:44.973318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:44.973318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-AttachVolumeShelveTestJSON-1086800830-project Sep 05 12:30:44.973318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:30:44.973318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:30:44.973318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 83d3b245c185424a9b6e5d69d691f031 Sep 05 12:30:44.973318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1086800830-project Sep 05 12:30:44.973318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:30:44.973318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:44.973318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '0055a73c-7732-48a3-b76b-3b8cc28e7804'} Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:30:44.974296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:44.976304 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:44.980768 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-55726086-2bd4-4552-9de1-89f0b5898cb0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Returning 404 to user: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:30:44.980768 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-55726086-2bd4-4552-9de1-89f0b5898cb0 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 404 len: 111 microversion: 2.20 time: 0.039341 Sep 05 12:30:44.980768 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 495/1002] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:44 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:30:44.986251 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8b165b5c-3d17-48d3-a376-d0519ebc6cac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '.version_select at 0x7fba4b89c940>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:45.007939 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8b165b5c-3d17-48d3-a376-d0519ebc6cac tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-456786505" status: 204 len: 0 microversion: 2.20 time: 0.025504 Sep 05 12:30:45.009256 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 508/1003] 10.222.0.16 () {60 vars in 1259 bytes} [Mon Sep 5 12:30:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-456786505 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 05 12:30:46.835763 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-18856b39-3598-433c-b641-9078ad690c81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:46.836269 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-18856b39-3598-433c-b641-9078ad690c81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:46.842647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-18856b39-3598-433c-b641-9078ad690c81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:46.843130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-18856b39-3598-433c-b641-9078ad690c81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:46.843606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-18856b39-3598-433c-b641-9078ad690c81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:46.844299 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-18856b39-3598-433c-b641-9078ad690c81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:46.844756 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-18856b39-3598-433c-b641-9078ad690c81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:46.845184 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-18856b39-3598-433c-b641-9078ad690c81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:46.858314 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-18856b39-3598-433c-b641-9078ad690c81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] HTTP exception thrown: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-18856b39-3598-433c-b641-9078ad690c81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Request method failure captured: Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: DELETE /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 HTTP/1.1 Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFekrqRS_NwomMhQqkMVzqnYC2XXZ0Xu1LzWsEsn_xtvRm9kUL9JPxa3yIn1RdmyywzbOT0h0KK1MjXyms-gagh4KPikA3AhPAWq52mOpkm_qo_9hlivRRj93Ft7gaGshkOmAY7XWNDbqsZN0h93vMUX8NhVMq6Js8kBnRNTTiZifl_o Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: ca5b70833b074d199437d3f10e511306 Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:30:46.859889 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:30:46.861543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca5b70833b074d199437d3f10e511306", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca5b70833b074d199437d3f10e511306"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca5b70833b074d199437d3f10e511306"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca5b70833b074d199437d3f10e511306"}]}] Sep 05 12:30:46.861543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:46.861543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: ca5b70833b074d199437d3f10e511306 Sep 05 12:30:46.861543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:46.861543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-AttachVolumeShelveTestJSON-1086800830-project Sep 05 12:30:46.861543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:30:46.861543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:30:46.861543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 83d3b245c185424a9b6e5d69d691f031 Sep 05 12:30:46.861543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1086800830-project Sep 05 12:30:46.861543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:30:46.861543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:46.861543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '0055a73c-7732-48a3-b76b-3b8cc28e7804'} Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:30:46.862605 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:46.864158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:46.865761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-18856b39-3598-433c-b641-9078ad690c81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Returning 404 to user: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:30:46.865761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-18856b39-3598-433c-b641-9078ad690c81 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 404 len: 111 microversion: 2.20 time: 0.029417 Sep 05 12:30:46.865761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 496/1004] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Sep 5 12:30:46 2022] DELETE /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:30:46.870255 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-50b5c5b1-bb3f-4fb0-9753-331b0804e1ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:46.870981 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-50b5c5b1-bb3f-4fb0-9753-331b0804e1ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 0055a73c-7732-48a3-b76b-3b8cc28e7804] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:46.877610 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-50b5c5b1-bb3f-4fb0-9753-331b0804e1ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:46.878086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-50b5c5b1-bb3f-4fb0-9753-331b0804e1ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:46.878522 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-50b5c5b1-bb3f-4fb0-9753-331b0804e1ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:46.879201 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-50b5c5b1-bb3f-4fb0-9753-331b0804e1ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:46.879690 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-50b5c5b1-bb3f-4fb0-9753-331b0804e1ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:46.880117 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-50b5c5b1-bb3f-4fb0-9753-331b0804e1ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:46.893967 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-50b5c5b1-bb3f-4fb0-9753-331b0804e1ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] HTTP exception thrown: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-50b5c5b1-bb3f-4fb0-9753-331b0804e1ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Request method failure captured: Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 HTTP/1.1 Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFekrqRS_NwomMhQqkMVzqnYC2XXZ0Xu1LzWsEsn_xtvRm9kUL9JPxa3yIn1RdmyywzbOT0h0KK1MjXyms-gagh4KPikA3AhPAWq52mOpkm_qo_9hlivRRj93Ft7gaGshkOmAY7XWNDbqsZN0h93vMUX8NhVMq6Js8kBnRNTTiZifl_o Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: ca5b70833b074d199437d3f10e511306 Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:30:46.895677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:30:46.897363 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca5b70833b074d199437d3f10e511306", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca5b70833b074d199437d3f10e511306"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca5b70833b074d199437d3f10e511306"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca5b70833b074d199437d3f10e511306"}]}] Sep 05 12:30:46.897363 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:46.897363 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: ca5b70833b074d199437d3f10e511306 Sep 05 12:30:46.897363 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:46.897363 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-AttachVolumeShelveTestJSON-1086800830-project Sep 05 12:30:46.897363 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:30:46.897363 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:30:46.897363 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: 83d3b245c185424a9b6e5d69d691f031 Sep 05 12:30:46.897363 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1086800830-project Sep 05 12:30:46.897363 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:30:46.897363 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:46.897363 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '0055a73c-7732-48a3-b76b-3b8cc28e7804'} Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:30:46.901477 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. Sep 05 12:30:46.903054 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:46.904939 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-50b5c5b1-bb3f-4fb0-9753-331b0804e1ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Returning 404 to user: Instance 0055a73c-7732-48a3-b76b-3b8cc28e7804 could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:30:46.904939 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-50b5c5b1-bb3f-4fb0-9753-331b0804e1ae tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804" status: 404 len: 111 microversion: 2.20 time: 0.031192 Sep 05 12:30:46.904939 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 509/1005] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:46 2022] GET /compute/v2.1/servers/0055a73c-7732-48a3-b76b-3b8cc28e7804 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:30:48.042088 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-89e9de72-f8b1-49c4-9e53-52f315ace8d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:48.042702 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-89e9de72-f8b1-49c4-9e53-52f315ace8d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:48.049852 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-89e9de72-f8b1-49c4-9e53-52f315ace8d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:48.050338 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-89e9de72-f8b1-49c4-9e53-52f315ace8d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:48.050776 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-89e9de72-f8b1-49c4-9e53-52f315ace8d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:48.051469 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-89e9de72-f8b1-49c4-9e53-52f315ace8d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:48.051947 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-89e9de72-f8b1-49c4-9e53-52f315ace8d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:48.052374 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-89e9de72-f8b1-49c4-9e53-52f315ace8d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:48.066564 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-89e9de72-f8b1-49c4-9e53-52f315ace8d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] HTTP exception thrown: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-89e9de72-f8b1-49c4-9e53-52f315ace8d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Request method failure captured: Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: DELETE /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c HTTP/1.1 Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFekrqRS_NwomMhQqkMVzqnYC2XXZ0Xu1LzWsEsn_xtvRm9kUL9JPxa3yIn1RdmyywzbOT0h0KK1MjXyms-gagh4KPikA3AhPAWq52mOpkm_qo_9hlivRRj93Ft7gaGshkOmAY7XWNDbqsZN0h93vMUX8NhVMq6Js8kBnRNTTiZifl_o Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: ca5b70833b074d199437d3f10e511306 Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:30:48.068139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:30:48.069887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca5b70833b074d199437d3f10e511306", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca5b70833b074d199437d3f10e511306"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca5b70833b074d199437d3f10e511306"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca5b70833b074d199437d3f10e511306"}]}] Sep 05 12:30:48.069887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:48.069887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: ca5b70833b074d199437d3f10e511306 Sep 05 12:30:48.069887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:48.069887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-AttachVolumeShelveTestJSON-1086800830-project Sep 05 12:30:48.069887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:30:48.069887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:30:48.069887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: 83d3b245c185424a9b6e5d69d691f031 Sep 05 12:30:48.069887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1086800830-project Sep 05 12:30:48.069887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:30:48.069887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:30:48.069887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '78cd9ae3-2a60-4905-a291-30169e41c86c'} Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:30:48.070932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:30:48.072238 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:30:48.073957 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-89e9de72-f8b1-49c4-9e53-52f315ace8d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Returning 404 to user: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:30:48.073957 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-89e9de72-f8b1-49c4-9e53-52f315ace8d9 tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 404 len: 111 microversion: 2.20 time: 0.031379 Sep 05 12:30:48.073957 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 497/1006] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Sep 5 12:30:48 2022] DELETE /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:30:48.077963 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-29c9607a-ac46-423a-bcd5-60490b91ba2e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:48.078563 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-29c9607a-ac46-423a-bcd5-60490b91ba2e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] [instance: 78cd9ae3-2a60-4905-a291-30169e41c86c] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:48.084957 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-29c9607a-ac46-423a-bcd5-60490b91ba2e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:48.085428 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-29c9607a-ac46-423a-bcd5-60490b91ba2e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:48.085856 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-29c9607a-ac46-423a-bcd5-60490b91ba2e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:48.086531 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-29c9607a-ac46-423a-bcd5-60490b91ba2e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:48.086978 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-29c9607a-ac46-423a-bcd5-60490b91ba2e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:48.087396 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-29c9607a-ac46-423a-bcd5-60490b91ba2e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:48.100448 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-29c9607a-ac46-423a-bcd5-60490b91ba2e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] HTTP exception thrown: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-29c9607a-ac46-423a-bcd5-60490b91ba2e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Request method failure captured: Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c HTTP/1.1 Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFekrqRS_NwomMhQqkMVzqnYC2XXZ0Xu1LzWsEsn_xtvRm9kUL9JPxa3yIn1RdmyywzbOT0h0KK1MjXyms-gagh4KPikA3AhPAWq52mOpkm_qo_9hlivRRj93Ft7gaGshkOmAY7XWNDbqsZN0h93vMUX8NhVMq6Js8kBnRNTTiZifl_o Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: ca5b70833b074d199437d3f10e511306 Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:30:48.101964 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:30:48.103696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca5b70833b074d199437d3f10e511306", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca5b70833b074d199437d3f10e511306"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca5b70833b074d199437d3f10e511306"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca5b70833b074d199437d3f10e511306"}]}] Sep 05 12:30:48.103696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:48.103696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: ca5b70833b074d199437d3f10e511306 Sep 05 12:30:48.103696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1086800830 Sep 05 12:30:48.103696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-AttachVolumeShelveTestJSON-1086800830-project Sep 05 12:30:48.103696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:30:48.103696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:30:48.103696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: 83d3b245c185424a9b6e5d69d691f031 Sep 05 12:30:48.103696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1086800830-project Sep 05 12:30:48.103696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:30:48.103696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:30:48.103696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '78cd9ae3-2a60-4905-a291-30169e41c86c'} Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:30:48.104775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. Sep 05 12:30:48.106288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:30:48.107760 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-29c9607a-ac46-423a-bcd5-60490b91ba2e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] Returning 404 to user: Instance 78cd9ae3-2a60-4905-a291-30169e41c86c could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:30:48.107760 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-29c9607a-ac46-423a-bcd5-60490b91ba2e tempest-AttachVolumeShelveTestJSON-1086800830 tempest-AttachVolumeShelveTestJSON-1086800830-project] 10.222.0.16 "GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c" status: 404 len: 111 microversion: 2.20 time: 0.029214 Sep 05 12:30:48.107760 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 510/1007] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:48 2022] GET /compute/v2.1/servers/78cd9ae3-2a60-4905-a291-30169e41c86c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 05 12:32:11.078495 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:32:11.078495 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Mon Sep 5 12:32:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 05 12:32:11.079617 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=19 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:11.080411 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=60 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:11.086472 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1876981494", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-246234878", "security_groups": [{"name": "tempest-secgroup-smoke-42412145"}], "block_device_mapping_v2": [{"uuid": "5a9559ac-1994-40c2-8668-b0f56b5466c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "22599f3e-588a-4fed-83e5-f9c661808b8f"}]}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:11.203473 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.network.neutron [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] validate_networks() for [('22599f3e-588a-4fed-83e5-f9c661808b8f', None, None, None, None, None)] {{(pid=120534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:32:11.602418 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Flavor limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:32:11.602944 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Image limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:32:11.603765 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Flavor pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:32:11.604177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Image pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:32:11.604630 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:32:11.613777 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:11.614845 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:11.615279 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:11.616066 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:11.616519 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:11.616955 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:11.634357 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Getting quotas for project 4d5cb05cfc60481fa4144ee7b077ca4f. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:32:11.638556 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Getting quotas for user ebd8a00f21344c7990ffe1a7ff2986ef and project 4d5cb05cfc60481fa4144ee7b077ca4f. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:32:11.698932 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Going to run 1 instances... {{(pid=120534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:32:11.701080 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a9559ac-1994-40c2-8668-b0f56b5466c7',volume_size=None,volume_type=None)] {{(pid=120534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:32:11.840907 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-23c96faa-ff0f-4d02-965d-8fa20cab2643 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.764245 Sep 05 12:32:11.841856 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 498/1008] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:32:11 2022] POST /compute/v2.1/servers => generated 404 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 05 12:32:11.854941 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-25db119b-61ce-4f1c-b7af-748c18361ca3 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:11.855762 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-25db119b-61ce-4f1c-b7af-748c18361ca3 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:11.858662 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:11.859808 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:11.920881 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-25db119b-61ce-4f1c-b7af-748c18361ca3 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:11.928365 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-25db119b-61ce-4f1c-b7af-748c18361ca3 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1094 microversion: 2.1 time: 0.078632 Sep 05 12:32:11.928930 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 511/1009] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:11 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:12.952537 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-131fe661-132f-4a91-bf54-df9d9d679f51 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:12.953154 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-131fe661-132f-4a91-bf54-df9d9d679f51 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:13.005576 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-131fe661-132f-4a91-bf54-df9d9d679f51 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:13.012664 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-131fe661-132f-4a91-bf54-df9d9d679f51 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1094 microversion: 2.1 time: 0.064602 Sep 05 12:32:13.013210 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 499/1010] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:12 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:14.035205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-86d19267-f984-41f8-b5f1-31fa5dc26bb4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:14.035864 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-86d19267-f984-41f8-b5f1-31fa5dc26bb4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:14.091499 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-86d19267-f984-41f8-b5f1-31fa5dc26bb4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:14.098701 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-86d19267-f984-41f8-b5f1-31fa5dc26bb4 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1094 microversion: 2.1 time: 0.067516 Sep 05 12:32:14.099301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 512/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:14 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:15.122778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-63af9f35-7fc8-4694-968a-d86ff8aea767 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:15.123404 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-63af9f35-7fc8-4694-968a-d86ff8aea767 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:15.181119 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-63af9f35-7fc8-4694-968a-d86ff8aea767 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:15.189448 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-63af9f35-7fc8-4694-968a-d86ff8aea767 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1094 microversion: 2.1 time: 0.071239 Sep 05 12:32:15.190044 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 500/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:15 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:16.219108 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e5af5cca-07f8-4cda-a0fb-c8b63b223b79 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:16.219742 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e5af5cca-07f8-4cda-a0fb-c8b63b223b79 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:16.227069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e5af5cca-07f8-4cda-a0fb-c8b63b223b79 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:16.227578 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e5af5cca-07f8-4cda-a0fb-c8b63b223b79 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:16.228010 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e5af5cca-07f8-4cda-a0fb-c8b63b223b79 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:16.228696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e5af5cca-07f8-4cda-a0fb-c8b63b223b79 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:16.229143 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e5af5cca-07f8-4cda-a0fb-c8b63b223b79 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:16.229566 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e5af5cca-07f8-4cda-a0fb-c8b63b223b79 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:16.292497 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e5af5cca-07f8-4cda-a0fb-c8b63b223b79 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:16.301659 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e5af5cca-07f8-4cda-a0fb-c8b63b223b79 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1144 microversion: 2.1 time: 0.085745 Sep 05 12:32:16.302441 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 513/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:16 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:17.326911 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-148e383b-6f61-459f-8480-27966b2d81f3 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:17.327536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-148e383b-6f61-459f-8480-27966b2d81f3 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:17.334810 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-148e383b-6f61-459f-8480-27966b2d81f3 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:17.335287 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-148e383b-6f61-459f-8480-27966b2d81f3 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:17.335764 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-148e383b-6f61-459f-8480-27966b2d81f3 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:17.336455 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-148e383b-6f61-459f-8480-27966b2d81f3 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:17.336910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-148e383b-6f61-459f-8480-27966b2d81f3 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:17.337336 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-148e383b-6f61-459f-8480-27966b2d81f3 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:17.401322 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-148e383b-6f61-459f-8480-27966b2d81f3 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:17.409120 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-148e383b-6f61-459f-8480-27966b2d81f3 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1210 microversion: 2.1 time: 0.086504 Sep 05 12:32:17.409700 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 501/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:17 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:18.432945 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-68e447ce-ea2c-4601-a1e5-06d4b30cdad5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:18.433550 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-68e447ce-ea2c-4601-a1e5-06d4b30cdad5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:18.439916 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-2273624a-5e35-4088-a062-0afcaff3c810 req-4622436d-1ca9-40d5-a27e-15ae4b1db813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7978ec-32b8-4e95-b4a2-924a1ef4d628", "tag": "9fa9a559-8f73-41cc-ad0f-fd13ddc4d5f2"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:18.440433 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68e447ce-ea2c-4601-a1e5-06d4b30cdad5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:18.440433 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68e447ce-ea2c-4601-a1e5-06d4b30cdad5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:18.440854 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68e447ce-ea2c-4601-a1e5-06d4b30cdad5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:18.441539 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68e447ce-ea2c-4601-a1e5-06d4b30cdad5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:18.441991 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68e447ce-ea2c-4601-a1e5-06d4b30cdad5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:18.442409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68e447ce-ea2c-4601-a1e5-06d4b30cdad5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:18.458425 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-2273624a-5e35-4088-a062-0afcaff3c810 req-4622436d-1ca9-40d5-a27e-15ae4b1db813 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:18.458901 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-2273624a-5e35-4088-a062-0afcaff3c810 req-4622436d-1ca9-40d5-a27e-15ae4b1db813 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:18.459560 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-2273624a-5e35-4088-a062-0afcaff3c810 req-4622436d-1ca9-40d5-a27e-15ae4b1db813 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:18.477719 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-2273624a-5e35-4088-a062-0afcaff3c810 req-4622436d-1ca9-40d5-a27e-15ae4b1db813 service nova] Creating event network-changed:9fa9a559-8f73-41cc-ad0f-fd13ddc4d5f2 for instance 5a7978ec-32b8-4e95-b4a2-924a1ef4d628 on hv-cinder-85518 Sep 05 12:32:18.482936 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-2273624a-5e35-4088-a062-0afcaff3c810 req-4622436d-1ca9-40d5-a27e-15ae4b1db813 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046731 Sep 05 12:32:18.483811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 502/1015] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:18.657062 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8aefb38e-e17d-4d6e-aaf9-c46feb6c6564 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:18.657639 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-8aefb38e-e17d-4d6e-aaf9-c46feb6c6564 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:18.664547 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8aefb38e-e17d-4d6e-aaf9-c46feb6c6564 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:18.665029 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8aefb38e-e17d-4d6e-aaf9-c46feb6c6564 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:18.665463 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8aefb38e-e17d-4d6e-aaf9-c46feb6c6564 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:18.666152 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8aefb38e-e17d-4d6e-aaf9-c46feb6c6564 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:18.666600 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8aefb38e-e17d-4d6e-aaf9-c46feb6c6564 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:18.667033 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8aefb38e-e17d-4d6e-aaf9-c46feb6c6564 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:18.689844 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8aefb38e-e17d-4d6e-aaf9-c46feb6c6564 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca/ips" status: 200 len: 150 microversion: 2.1 time: 0.037011 Sep 05 12:32:18.690047 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-68e447ce-ea2c-4601-a1e5-06d4b30cdad5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:18.697832 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 503/1016] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Sep 5 12:32:18 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:32:18.698359 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-68e447ce-ea2c-4601-a1e5-06d4b30cdad5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1264 microversion: 2.1 time: 0.269436 Sep 05 12:32:18.698994 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 514/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:18 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:19.721893 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c6586c47-a152-45f0-86d9-354b0fd2fce1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:19.722414 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-c6586c47-a152-45f0-86d9-354b0fd2fce1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:19.728861 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6586c47-a152-45f0-86d9-354b0fd2fce1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:19.729365 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6586c47-a152-45f0-86d9-354b0fd2fce1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:19.729801 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6586c47-a152-45f0-86d9-354b0fd2fce1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:19.730486 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6586c47-a152-45f0-86d9-354b0fd2fce1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:19.730940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6586c47-a152-45f0-86d9-354b0fd2fce1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:19.731408 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-c6586c47-a152-45f0-86d9-354b0fd2fce1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:19.864231 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-c6586c47-a152-45f0-86d9-354b0fd2fce1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:19.873208 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c6586c47-a152-45f0-86d9-354b0fd2fce1 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1264 microversion: 2.1 time: 0.155197 Sep 05 12:32:19.873810 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 504/1018] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:19 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:20.082633 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d56ac5fa-b46f-4691-9afb-21413f03b789 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50da9cb3-bd4f-4c06-b4bb-abbecf3415be"}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:20.085097 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d56ac5fa-b46f-4691-9afb-21413f03b789 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:20.091196 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d56ac5fa-b46f-4691-9afb-21413f03b789 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:20.091702 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d56ac5fa-b46f-4691-9afb-21413f03b789 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:20.092137 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d56ac5fa-b46f-4691-9afb-21413f03b789 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:20.092826 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d56ac5fa-b46f-4691-9afb-21413f03b789 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:20.093276 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d56ac5fa-b46f-4691-9afb-21413f03b789 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:20.093698 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d56ac5fa-b46f-4691-9afb-21413f03b789 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:20.396290 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d56ac5fa-b46f-4691-9afb-21413f03b789 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "POST /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317408 Sep 05 12:32:20.399559 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 515/1019] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Sep 5 12:32:20 2022] POST /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:20.896753 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7314850c-f38c-428b-a9f4-11a091878fd5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:20.897543 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7314850c-f38c-428b-a9f4-11a091878fd5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:20.904030 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7314850c-f38c-428b-a9f4-11a091878fd5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:20.904515 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7314850c-f38c-428b-a9f4-11a091878fd5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:20.904958 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7314850c-f38c-428b-a9f4-11a091878fd5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:20.905656 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7314850c-f38c-428b-a9f4-11a091878fd5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:20.906127 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7314850c-f38c-428b-a9f4-11a091878fd5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:20.906558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7314850c-f38c-428b-a9f4-11a091878fd5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:21.041566 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7314850c-f38c-428b-a9f4-11a091878fd5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:21.049168 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7314850c-f38c-428b-a9f4-11a091878fd5 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1264 microversion: 2.1 time: 0.156448 Sep 05 12:32:21.049731 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 505/1020] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:20 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:22.074855 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7e778da1-f0f2-426d-bc4b-c7ecc0516d34 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:22.075610 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7e778da1-f0f2-426d-bc4b-c7ecc0516d34 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:22.081980 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7e778da1-f0f2-426d-bc4b-c7ecc0516d34 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:22.083134 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7e778da1-f0f2-426d-bc4b-c7ecc0516d34 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:22.083627 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7e778da1-f0f2-426d-bc4b-c7ecc0516d34 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:22.084384 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7e778da1-f0f2-426d-bc4b-c7ecc0516d34 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:22.084840 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7e778da1-f0f2-426d-bc4b-c7ecc0516d34 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:22.085272 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7e778da1-f0f2-426d-bc4b-c7ecc0516d34 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:22.486141 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-7e778da1-f0f2-426d-bc4b-c7ecc0516d34 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:22.494292 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7e778da1-f0f2-426d-bc4b-c7ecc0516d34 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1264 microversion: 2.1 time: 0.424232 Sep 05 12:32:22.494850 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 516/1021] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:22 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1264 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:23.518052 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-de11be5e-1f35-43fd-908e-1bb8419ba45e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:23.518702 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-de11be5e-1f35-43fd-908e-1bb8419ba45e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:23.521262 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:23.527258 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de11be5e-1f35-43fd-908e-1bb8419ba45e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:23.527768 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de11be5e-1f35-43fd-908e-1bb8419ba45e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:23.528213 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de11be5e-1f35-43fd-908e-1bb8419ba45e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:23.529028 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de11be5e-1f35-43fd-908e-1bb8419ba45e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:23.529487 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de11be5e-1f35-43fd-908e-1bb8419ba45e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:23.529920 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de11be5e-1f35-43fd-908e-1bb8419ba45e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:23.665907 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-de11be5e-1f35-43fd-908e-1bb8419ba45e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:23.673619 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-de11be5e-1f35-43fd-908e-1bb8419ba45e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1264 microversion: 2.1 time: 0.159457 Sep 05 12:32:23.674190 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 506/1022] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:23 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:24.697016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c3a4d48b-9859-4552-b675-79f282361cb9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:24.697662 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c3a4d48b-9859-4552-b675-79f282361cb9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:24.700146 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=4 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:24.705505 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c3a4d48b-9859-4552-b675-79f282361cb9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:24.705988 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c3a4d48b-9859-4552-b675-79f282361cb9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:24.706424 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c3a4d48b-9859-4552-b675-79f282361cb9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:24.707116 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c3a4d48b-9859-4552-b675-79f282361cb9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:24.707605 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c3a4d48b-9859-4552-b675-79f282361cb9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:24.708035 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c3a4d48b-9859-4552-b675-79f282361cb9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:24.837836 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c3a4d48b-9859-4552-b675-79f282361cb9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:24.845729 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c3a4d48b-9859-4552-b675-79f282361cb9 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1264 microversion: 2.1 time: 0.152522 Sep 05 12:32:24.846291 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 517/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:24 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:25.869093 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-32e711c9-ea06-4b09-b757-ad3e9c1e4075 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:25.869707 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-32e711c9-ea06-4b09-b757-ad3e9c1e4075 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:25.872149 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=10 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:25.877669 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-32e711c9-ea06-4b09-b757-ad3e9c1e4075 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:25.878145 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-32e711c9-ea06-4b09-b757-ad3e9c1e4075 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:25.878574 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-32e711c9-ea06-4b09-b757-ad3e9c1e4075 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:25.879838 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-32e711c9-ea06-4b09-b757-ad3e9c1e4075 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:25.880287 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-32e711c9-ea06-4b09-b757-ad3e9c1e4075 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:25.880703 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-32e711c9-ea06-4b09-b757-ad3e9c1e4075 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:26.010325 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-32e711c9-ea06-4b09-b757-ad3e9c1e4075 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:26.017925 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-32e711c9-ea06-4b09-b757-ad3e9c1e4075 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1264 microversion: 2.1 time: 0.152790 Sep 05 12:32:26.018482 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 507/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:25 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:27.041560 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8f721cda-8662-4128-a6f9-9393658b3ff2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:27.042173 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8f721cda-8662-4128-a6f9-9393658b3ff2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:27.048629 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8f721cda-8662-4128-a6f9-9393658b3ff2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:27.049107 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8f721cda-8662-4128-a6f9-9393658b3ff2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:27.049538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8f721cda-8662-4128-a6f9-9393658b3ff2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:27.050222 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8f721cda-8662-4128-a6f9-9393658b3ff2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:27.050683 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8f721cda-8662-4128-a6f9-9393658b3ff2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:27.051102 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8f721cda-8662-4128-a6f9-9393658b3ff2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:27.181974 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8f721cda-8662-4128-a6f9-9393658b3ff2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:27.189579 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8f721cda-8662-4128-a6f9-9393658b3ff2 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1264 microversion: 2.1 time: 0.151965 Sep 05 12:32:27.190136 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 518/1025] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:27 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:27.936147 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-c182b8cf-4811-4bd4-8f13-6f4152807253 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Action: 'create', calling method: .version_select at 0x7fba4ba37790>, body: {"keypair": {"name": "tempest-keypair-2072467200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6pD9EOIL0tTivGyQ7HQhPWczVlbKf7dQMBFEdJH9fAQffGKSAy4m8LQ/L0d+anMDR38pgqjP+yMcTLUUQyzvYyV1+ByabKL21orFgJbcd+bMKGdbpWcUCMfGr3lbDmtQ=="}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:27.951819 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-c182b8cf-4811-4bd4-8f13-6f4152807253 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'key_pairs'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:32:27.955675 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-c182b8cf-4811-4bd4-8f13-6f4152807253 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for user ee580cfc10dd4536b0709e65e3d23d4d and project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'key_pairs'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:32:27.977797 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-c182b8cf-4811-4bd4-8f13-6f4152807253 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045522 Sep 05 12:32:27.978388 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 508/1026] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Sep 5 12:32:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:28.212239 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6656b3c0-5f0a-4a5d-8cf9-dc5bbb72affd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:28.212944 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6656b3c0-5f0a-4a5d-8cf9-dc5bbb72affd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:28.219448 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6656b3c0-5f0a-4a5d-8cf9-dc5bbb72affd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:28.220166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6656b3c0-5f0a-4a5d-8cf9-dc5bbb72affd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:28.220541 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6656b3c0-5f0a-4a5d-8cf9-dc5bbb72affd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:28.222239 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6656b3c0-5f0a-4a5d-8cf9-dc5bbb72affd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:28.223812 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6656b3c0-5f0a-4a5d-8cf9-dc5bbb72affd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:28.224413 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6656b3c0-5f0a-4a5d-8cf9-dc5bbb72affd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:28.363602 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6656b3c0-5f0a-4a5d-8cf9-dc5bbb72affd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:28.371483 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6656b3c0-5f0a-4a5d-8cf9-dc5bbb72affd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1264 microversion: 2.1 time: 0.163045 Sep 05 12:32:28.372090 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 519/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:28 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:29.220569 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1366740965", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49732eeb-e082-4048-831f-1af5d3375981"}], "security_groups": [{"name": "tempest-securitygroup--2146048490"}], "key_name": "tempest-keypair-2072467200", "user_data": "}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:29.327496 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.network.neutron [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] validate_networks() for [('49732eeb-e082-4048-831f-1af5d3375981', None, None, None, None, None)] {{(pid=120534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:32:29.395619 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-eba19912-9983-4df9-bacc-b54a769f5b7b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:29.396239 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-eba19912-9983-4df9-bacc-b54a769f5b7b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:29.403417 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eba19912-9983-4df9-bacc-b54a769f5b7b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:29.403958 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eba19912-9983-4df9-bacc-b54a769f5b7b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:29.404966 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eba19912-9983-4df9-bacc-b54a769f5b7b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:29.405149 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eba19912-9983-4df9-bacc-b54a769f5b7b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:29.405889 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eba19912-9983-4df9-bacc-b54a769f5b7b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:29.406359 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-eba19912-9983-4df9-bacc-b54a769f5b7b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:29.551645 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-eba19912-9983-4df9-bacc-b54a769f5b7b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:29.562320 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-eba19912-9983-4df9-bacc-b54a769f5b7b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1264 microversion: 2.1 time: 0.170422 Sep 05 12:32:29.562918 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 520/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:29 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:30.053865 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Flavor limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:32:30.054314 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Image limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:32:30.054781 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Flavor pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:32:30.055190 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Image pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:32:30.055639 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:32:30.064803 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:30.065278 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:30.065705 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:30.066959 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:30.067410 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:30.067866 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:30.085252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:32:30.089574 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for user ee580cfc10dd4536b0709e65e3d23d4d and project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:32:30.101275 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Going to run 1 instances... {{(pid=120534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:32:30.103491 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:32:30.151078 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-07abb0e9-124f-4d8e-9ef8-7dd25c1333bb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.935244 Sep 05 12:32:30.151761 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 509/1029] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:32:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:32:30.162851 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8c847644-889b-4ac7-882b-508bdf478088 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:30.163463 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8c847644-889b-4ac7-882b-508bdf478088 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:30.219839 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8c847644-889b-4ac7-882b-508bdf478088 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:30.227453 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8c847644-889b-4ac7-882b-508bdf478088 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1242 microversion: 2.1 time: 0.068397 Sep 05 12:32:30.228066 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 521/1030] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:30 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:30.585319 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e33b4db0-2ec2-40ce-9ee3-51ecaef6cf91 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:30.585923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e33b4db0-2ec2-40ce-9ee3-51ecaef6cf91 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:30.592656 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e33b4db0-2ec2-40ce-9ee3-51ecaef6cf91 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:30.593229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e33b4db0-2ec2-40ce-9ee3-51ecaef6cf91 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:30.593578 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e33b4db0-2ec2-40ce-9ee3-51ecaef6cf91 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:30.594269 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e33b4db0-2ec2-40ce-9ee3-51ecaef6cf91 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:30.594724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e33b4db0-2ec2-40ce-9ee3-51ecaef6cf91 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:30.595152 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e33b4db0-2ec2-40ce-9ee3-51ecaef6cf91 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:30.725259 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e33b4db0-2ec2-40ce-9ee3-51ecaef6cf91 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:30.734203 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e33b4db0-2ec2-40ce-9ee3-51ecaef6cf91 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1264 microversion: 2.1 time: 0.153185 Sep 05 12:32:30.734780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 510/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:30 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:31.250100 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2ee16b1b-6a1b-4afe-bd67-1aa77a95bde5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:31.250656 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2ee16b1b-6a1b-4afe-bd67-1aa77a95bde5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:31.257127 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2ee16b1b-6a1b-4afe-bd67-1aa77a95bde5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:31.257603 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2ee16b1b-6a1b-4afe-bd67-1aa77a95bde5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:31.258034 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2ee16b1b-6a1b-4afe-bd67-1aa77a95bde5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:31.258723 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2ee16b1b-6a1b-4afe-bd67-1aa77a95bde5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:31.259175 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2ee16b1b-6a1b-4afe-bd67-1aa77a95bde5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:31.259636 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2ee16b1b-6a1b-4afe-bd67-1aa77a95bde5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:31.322519 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2ee16b1b-6a1b-4afe-bd67-1aa77a95bde5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:31.330088 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2ee16b1b-6a1b-4afe-bd67-1aa77a95bde5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1294 microversion: 2.1 time: 0.083951 Sep 05 12:32:31.343544 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 522/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:31 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:31.469272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-b5f05953-1642-4b01-9b0b-c94e0ec1f324 req-ab21af57-f7da-4987-ab5b-806761633d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7978ec-32b8-4e95-b4a2-924a1ef4d628", "name": "network-vif-plugged", "status": "completed", "tag": "9fa9a559-8f73-41cc-ad0f-fd13ddc4d5f2"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:31.481997 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-b5f05953-1642-4b01-9b0b-c94e0ec1f324 req-ab21af57-f7da-4987-ab5b-806761633d7c service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:31.482733 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-b5f05953-1642-4b01-9b0b-c94e0ec1f324 req-ab21af57-f7da-4987-ab5b-806761633d7c service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:31.483345 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-b5f05953-1642-4b01-9b0b-c94e0ec1f324 req-ab21af57-f7da-4987-ab5b-806761633d7c service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:31.499887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-b5f05953-1642-4b01-9b0b-c94e0ec1f324 req-ab21af57-f7da-4987-ab5b-806761633d7c service nova] Creating event network-vif-plugged:9fa9a559-8f73-41cc-ad0f-fd13ddc4d5f2 for instance 5a7978ec-32b8-4e95-b4a2-924a1ef4d628 on hv-cinder-85518 Sep 05 12:32:31.507127 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-b5f05953-1642-4b01-9b0b-c94e0ec1f324 req-ab21af57-f7da-4987-ab5b-806761633d7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041321 Sep 05 12:32:31.509505 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 511/1033] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:31.758594 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0222deca-8d37-48e8-81bd-9a5ee38b8648 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:31.759123 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0222deca-8d37-48e8-81bd-9a5ee38b8648 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:31.765682 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0222deca-8d37-48e8-81bd-9a5ee38b8648 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:31.766165 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0222deca-8d37-48e8-81bd-9a5ee38b8648 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:31.768556 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0222deca-8d37-48e8-81bd-9a5ee38b8648 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:31.768556 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0222deca-8d37-48e8-81bd-9a5ee38b8648 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:31.768556 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0222deca-8d37-48e8-81bd-9a5ee38b8648 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:31.768556 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0222deca-8d37-48e8-81bd-9a5ee38b8648 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:32.053853 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0222deca-8d37-48e8-81bd-9a5ee38b8648 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:32.061669 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0222deca-8d37-48e8-81bd-9a5ee38b8648 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1264 microversion: 2.1 time: 0.307588 Sep 05 12:32:32.062244 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 523/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:31 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1264 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:32.355638 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-94336d82-ab8b-4e22-adc7-593a07bd326a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:32.356356 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-94336d82-ab8b-4e22-adc7-593a07bd326a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:32.363334 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-94336d82-ab8b-4e22-adc7-593a07bd326a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:32.364689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-94336d82-ab8b-4e22-adc7-593a07bd326a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:32.365166 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-94336d82-ab8b-4e22-adc7-593a07bd326a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:32.365928 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-94336d82-ab8b-4e22-adc7-593a07bd326a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:32.366387 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-94336d82-ab8b-4e22-adc7-593a07bd326a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:32.367018 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-94336d82-ab8b-4e22-adc7-593a07bd326a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:32.514704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-94336d82-ab8b-4e22-adc7-593a07bd326a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:32.522946 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-94336d82-ab8b-4e22-adc7-593a07bd326a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1368 microversion: 2.1 time: 0.172063 Sep 05 12:32:32.523540 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 512/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:32 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:33.085910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4c0031f2-9879-456e-b93a-57b207248520 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:33.086600 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4c0031f2-9879-456e-b93a-57b207248520 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:33.093433 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c0031f2-9879-456e-b93a-57b207248520 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:33.093917 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c0031f2-9879-456e-b93a-57b207248520 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:33.094368 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c0031f2-9879-456e-b93a-57b207248520 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:33.095073 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c0031f2-9879-456e-b93a-57b207248520 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:33.095550 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c0031f2-9879-456e-b93a-57b207248520 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:33.095978 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4c0031f2-9879-456e-b93a-57b207248520 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:33.130403 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-c2639c67-612e-45ca-be6a-62fdeb19bdba req-49a136ea-0125-4558-a7fe-7997ac0a139b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17707518-9625-4f2a-9c46-a3efa0079962", "tag": "89198988-8838-4912-880d-01b3b244c58d"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:33.140529 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-c2639c67-612e-45ca-be6a-62fdeb19bdba req-49a136ea-0125-4558-a7fe-7997ac0a139b service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:33.140914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-c2639c67-612e-45ca-be6a-62fdeb19bdba req-49a136ea-0125-4558-a7fe-7997ac0a139b service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:33.141704 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-c2639c67-612e-45ca-be6a-62fdeb19bdba req-49a136ea-0125-4558-a7fe-7997ac0a139b service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:33.154059 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-c2639c67-612e-45ca-be6a-62fdeb19bdba req-49a136ea-0125-4558-a7fe-7997ac0a139b service nova] Creating event network-changed:89198988-8838-4912-880d-01b3b244c58d for instance 17707518-9625-4f2a-9c46-a3efa0079962 on hv-cinder-85518 Sep 05 12:32:33.158739 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-c2639c67-612e-45ca-be6a-62fdeb19bdba req-49a136ea-0125-4558-a7fe-7997ac0a139b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033718 Sep 05 12:32:33.159555 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 513/1036] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:32:33.287702 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4c0031f2-9879-456e-b93a-57b207248520 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:33.297693 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4c0031f2-9879-456e-b93a-57b207248520 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1264 microversion: 2.1 time: 0.215519 Sep 05 12:32:33.298430 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 524/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:33 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:33.547751 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-59c4b6b1-e6a4-4eda-89e9-219bc6f22353 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:33.548604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-59c4b6b1-e6a4-4eda-89e9-219bc6f22353 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:33.555915 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-59c4b6b1-e6a4-4eda-89e9-219bc6f22353 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:33.556441 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-59c4b6b1-e6a4-4eda-89e9-219bc6f22353 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:33.556957 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-59c4b6b1-e6a4-4eda-89e9-219bc6f22353 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:33.557792 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-59c4b6b1-e6a4-4eda-89e9-219bc6f22353 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:33.558328 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-59c4b6b1-e6a4-4eda-89e9-219bc6f22353 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:33.558793 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-59c4b6b1-e6a4-4eda-89e9-219bc6f22353 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:33.692600 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-59c4b6b1-e6a4-4eda-89e9-219bc6f22353 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:33.701259 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-59c4b6b1-e6a4-4eda-89e9-219bc6f22353 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1368 microversion: 2.1 time: 0.158253 Sep 05 12:32:33.701259 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 514/1038] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:33 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:34.325296 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-bc965c99-3dea-4c5d-95bd-08f3bd14276e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:34.325871 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-bc965c99-3dea-4c5d-95bd-08f3bd14276e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:34.333399 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bc965c99-3dea-4c5d-95bd-08f3bd14276e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:34.333892 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bc965c99-3dea-4c5d-95bd-08f3bd14276e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:34.334345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bc965c99-3dea-4c5d-95bd-08f3bd14276e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:34.335099 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bc965c99-3dea-4c5d-95bd-08f3bd14276e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:34.335562 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bc965c99-3dea-4c5d-95bd-08f3bd14276e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:34.335984 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bc965c99-3dea-4c5d-95bd-08f3bd14276e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:34.471859 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-bc965c99-3dea-4c5d-95bd-08f3bd14276e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:34.480260 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-bc965c99-3dea-4c5d-95bd-08f3bd14276e tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1452 microversion: 2.1 time: 0.159069 Sep 05 12:32:34.480824 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 525/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:34 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:34.503126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a39d811e-c9df-444a-b815-ee3b48316bbe tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:34.503777 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a39d811e-c9df-444a-b815-ee3b48316bbe tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:34.509756 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a39d811e-c9df-444a-b815-ee3b48316bbe tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:34.510240 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a39d811e-c9df-444a-b815-ee3b48316bbe tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:34.510692 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a39d811e-c9df-444a-b815-ee3b48316bbe tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:34.511395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a39d811e-c9df-444a-b815-ee3b48316bbe tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:34.511877 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a39d811e-c9df-444a-b815-ee3b48316bbe tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:34.512312 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a39d811e-c9df-444a-b815-ee3b48316bbe tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:34.646011 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a39d811e-c9df-444a-b815-ee3b48316bbe tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:34.653887 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a39d811e-c9df-444a-b815-ee3b48316bbe tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1452 microversion: 2.1 time: 0.154623 Sep 05 12:32:34.654440 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 515/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:34 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:34.722160 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-68424319-9888-4f37-acee-026858ea03a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:34.722879 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-68424319-9888-4f37-acee-026858ea03a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:34.728868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68424319-9888-4f37-acee-026858ea03a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:34.729353 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68424319-9888-4f37-acee-026858ea03a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:34.729798 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68424319-9888-4f37-acee-026858ea03a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:34.730524 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68424319-9888-4f37-acee-026858ea03a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:34.730979 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68424319-9888-4f37-acee-026858ea03a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:34.731408 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-68424319-9888-4f37-acee-026858ea03a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:34.901982 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-68424319-9888-4f37-acee-026858ea03a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:34.909727 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-68424319-9888-4f37-acee-026858ea03a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1368 microversion: 2.1 time: 0.191414 Sep 05 12:32:34.910288 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 526/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:34 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:35.932917 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-962fd764-2150-41b3-8248-72f5cd275fa0 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:35.933542 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-962fd764-2150-41b3-8248-72f5cd275fa0 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:35.940217 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-962fd764-2150-41b3-8248-72f5cd275fa0 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:35.940705 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-962fd764-2150-41b3-8248-72f5cd275fa0 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:35.941142 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-962fd764-2150-41b3-8248-72f5cd275fa0 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:35.941846 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-962fd764-2150-41b3-8248-72f5cd275fa0 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:35.942373 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-962fd764-2150-41b3-8248-72f5cd275fa0 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:35.942804 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-962fd764-2150-41b3-8248-72f5cd275fa0 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:36.078511 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-962fd764-2150-41b3-8248-72f5cd275fa0 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:36.087084 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-962fd764-2150-41b3-8248-72f5cd275fa0 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1368 microversion: 2.1 time: 0.158006 Sep 05 12:32:36.087699 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 516/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:35 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:36.404165 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-75bee83b-bd91-46ca-95b2-3f2bf4d0df56 req-9504141a-c0bd-447e-8e61-0790fa69bdef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7978ec-32b8-4e95-b4a2-924a1ef4d628", "tag": "9fa9a559-8f73-41cc-ad0f-fd13ddc4d5f2"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:36.414894 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-75bee83b-bd91-46ca-95b2-3f2bf4d0df56 req-9504141a-c0bd-447e-8e61-0790fa69bdef service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:36.415376 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-75bee83b-bd91-46ca-95b2-3f2bf4d0df56 req-9504141a-c0bd-447e-8e61-0790fa69bdef service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:36.415833 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-75bee83b-bd91-46ca-95b2-3f2bf4d0df56 req-9504141a-c0bd-447e-8e61-0790fa69bdef service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:36.430360 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-75bee83b-bd91-46ca-95b2-3f2bf4d0df56 req-9504141a-c0bd-447e-8e61-0790fa69bdef service nova] Creating event network-changed:9fa9a559-8f73-41cc-ad0f-fd13ddc4d5f2 for instance 5a7978ec-32b8-4e95-b4a2-924a1ef4d628 on hv-cinder-85518 Sep 05 12:32:36.435512 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-75bee83b-bd91-46ca-95b2-3f2bf4d0df56 req-9504141a-c0bd-447e-8e61-0790fa69bdef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034986 Sep 05 12:32:36.436329 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 527/1043] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:37.110412 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-4ae56eae-80a8-4794-8208-4b9aad4eb2e2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:37.111191 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-4ae56eae-80a8-4794-8208-4b9aad4eb2e2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:37.119604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4ae56eae-80a8-4794-8208-4b9aad4eb2e2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:37.120102 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4ae56eae-80a8-4794-8208-4b9aad4eb2e2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:37.120534 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4ae56eae-80a8-4794-8208-4b9aad4eb2e2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:37.121424 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4ae56eae-80a8-4794-8208-4b9aad4eb2e2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:37.122073 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4ae56eae-80a8-4794-8208-4b9aad4eb2e2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:37.122506 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-4ae56eae-80a8-4794-8208-4b9aad4eb2e2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:37.281952 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-4ae56eae-80a8-4794-8208-4b9aad4eb2e2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:37.305442 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-4ae56eae-80a8-4794-8208-4b9aad4eb2e2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1368 microversion: 2.1 time: 0.198858 Sep 05 12:32:37.308173 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 517/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:37 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:38.331293 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a9aac6a9-b775-4502-8048-741130e58a29 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:38.332016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a9aac6a9-b775-4502-8048-741130e58a29 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:38.338436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9aac6a9-b775-4502-8048-741130e58a29 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:38.338927 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9aac6a9-b775-4502-8048-741130e58a29 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:38.339368 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9aac6a9-b775-4502-8048-741130e58a29 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:38.340095 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9aac6a9-b775-4502-8048-741130e58a29 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:38.340558 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9aac6a9-b775-4502-8048-741130e58a29 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:38.340986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a9aac6a9-b775-4502-8048-741130e58a29 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:38.479202 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a9aac6a9-b775-4502-8048-741130e58a29 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:38.487389 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a9aac6a9-b775-4502-8048-741130e58a29 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1368 microversion: 2.1 time: 0.160869 Sep 05 12:32:38.487984 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 528/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:38 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:39.510876 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-bd4d6c8d-a0ab-4f4a-a273-8f7d3b5d776b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:39.511497 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-bd4d6c8d-a0ab-4f4a-a273-8f7d3b5d776b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:39.518232 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bd4d6c8d-a0ab-4f4a-a273-8f7d3b5d776b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:39.518768 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bd4d6c8d-a0ab-4f4a-a273-8f7d3b5d776b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:39.519241 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bd4d6c8d-a0ab-4f4a-a273-8f7d3b5d776b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:39.520705 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bd4d6c8d-a0ab-4f4a-a273-8f7d3b5d776b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:39.521373 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bd4d6c8d-a0ab-4f4a-a273-8f7d3b5d776b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:39.522158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bd4d6c8d-a0ab-4f4a-a273-8f7d3b5d776b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:39.656833 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-bd4d6c8d-a0ab-4f4a-a273-8f7d3b5d776b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:39.665027 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-bd4d6c8d-a0ab-4f4a-a273-8f7d3b5d776b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1368 microversion: 2.1 time: 0.158295 Sep 05 12:32:39.665611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 518/1046] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:39 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:40.688085 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d7a41263-122a-43bf-a878-5757956a99a7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:40.688624 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d7a41263-122a-43bf-a878-5757956a99a7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:40.691018 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:40.697240 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d7a41263-122a-43bf-a878-5757956a99a7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:40.697731 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d7a41263-122a-43bf-a878-5757956a99a7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:40.698172 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d7a41263-122a-43bf-a878-5757956a99a7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:40.698868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d7a41263-122a-43bf-a878-5757956a99a7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:40.699327 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d7a41263-122a-43bf-a878-5757956a99a7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:40.699790 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d7a41263-122a-43bf-a878-5757956a99a7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:40.829399 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d7a41263-122a-43bf-a878-5757956a99a7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:40.832832 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:40.838050 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d7a41263-122a-43bf-a878-5757956a99a7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1368 microversion: 2.1 time: 0.153953 Sep 05 12:32:40.838609 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 529/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:40 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:41.492034 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-6dea786c-ba11-4814-91d7-b5aa5d0e943b req-de0282ed-534a-403a-af15-8fe5ce40d731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17707518-9625-4f2a-9c46-a3efa0079962", "name": "network-vif-plugged", "status": "completed", "tag": "89198988-8838-4912-880d-01b3b244c58d"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:41.493685 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:41.494775 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=10 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:41.496306 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:41.503793 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6dea786c-ba11-4814-91d7-b5aa5d0e943b req-de0282ed-534a-403a-af15-8fe5ce40d731 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:41.504809 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6dea786c-ba11-4814-91d7-b5aa5d0e943b req-de0282ed-534a-403a-af15-8fe5ce40d731 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:41.505247 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6dea786c-ba11-4814-91d7-b5aa5d0e943b req-de0282ed-534a-403a-af15-8fe5ce40d731 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:41.510243 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=87 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:41.518730 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-6dea786c-ba11-4814-91d7-b5aa5d0e943b req-de0282ed-534a-403a-af15-8fe5ce40d731 service nova] Creating event network-vif-plugged:89198988-8838-4912-880d-01b3b244c58d for instance 17707518-9625-4f2a-9c46-a3efa0079962 on hv-cinder-85518 Sep 05 12:32:41.525118 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-6dea786c-ba11-4814-91d7-b5aa5d0e943b req-de0282ed-534a-403a-af15-8fe5ce40d731 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041064 Sep 05 12:32:41.525942 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 519/1048] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:41.861374 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8296adff-3cd3-4a4f-8556-72d12937e453 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:41.861973 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8296adff-3cd3-4a4f-8556-72d12937e453 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:41.869873 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8296adff-3cd3-4a4f-8556-72d12937e453 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:41.870351 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8296adff-3cd3-4a4f-8556-72d12937e453 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:41.870817 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8296adff-3cd3-4a4f-8556-72d12937e453 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:41.871505 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8296adff-3cd3-4a4f-8556-72d12937e453 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:41.871985 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8296adff-3cd3-4a4f-8556-72d12937e453 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:41.872408 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8296adff-3cd3-4a4f-8556-72d12937e453 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:41.998974 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8296adff-3cd3-4a4f-8556-72d12937e453 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:42.007414 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8296adff-3cd3-4a4f-8556-72d12937e453 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1368 microversion: 2.1 time: 0.150064 Sep 05 12:32:42.008001 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 530/1049] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:41 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:43.031204 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-bac3e463-40de-49d9-8e30-2371ec0825eb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:43.031963 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-bac3e463-40de-49d9-8e30-2371ec0825eb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:43.038158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bac3e463-40de-49d9-8e30-2371ec0825eb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:43.038635 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bac3e463-40de-49d9-8e30-2371ec0825eb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:43.039068 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bac3e463-40de-49d9-8e30-2371ec0825eb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:43.039790 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bac3e463-40de-49d9-8e30-2371ec0825eb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:43.040243 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bac3e463-40de-49d9-8e30-2371ec0825eb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:43.040671 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bac3e463-40de-49d9-8e30-2371ec0825eb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:43.169033 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-bac3e463-40de-49d9-8e30-2371ec0825eb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:43.177394 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-bac3e463-40de-49d9-8e30-2371ec0825eb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1368 microversion: 2.1 time: 0.150877 Sep 05 12:32:43.177971 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 520/1050] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:43 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:44.200803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9405c599-fd28-49f1-9fe8-99cf10212893 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:44.201446 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-9405c599-fd28-49f1-9fe8-99cf10212893 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:44.203837 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=47 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:44.209703 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9405c599-fd28-49f1-9fe8-99cf10212893 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:44.210188 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9405c599-fd28-49f1-9fe8-99cf10212893 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:44.210620 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9405c599-fd28-49f1-9fe8-99cf10212893 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:44.211316 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9405c599-fd28-49f1-9fe8-99cf10212893 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:44.211802 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9405c599-fd28-49f1-9fe8-99cf10212893 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:44.212230 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9405c599-fd28-49f1-9fe8-99cf10212893 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:44.353097 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-9405c599-fd28-49f1-9fe8-99cf10212893 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:44.360776 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9405c599-fd28-49f1-9fe8-99cf10212893 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1558 microversion: 2.1 time: 0.163882 Sep 05 12:32:44.361337 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 531/1051] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:44 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:44.383160 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-79e7f604-dc2c-4ef8-92d8-9a0f23633448 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:44.383771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-79e7f604-dc2c-4ef8-92d8-9a0f23633448 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:44.390312 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79e7f604-dc2c-4ef8-92d8-9a0f23633448 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:44.390800 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79e7f604-dc2c-4ef8-92d8-9a0f23633448 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:44.391240 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79e7f604-dc2c-4ef8-92d8-9a0f23633448 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:44.391974 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79e7f604-dc2c-4ef8-92d8-9a0f23633448 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:44.392432 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79e7f604-dc2c-4ef8-92d8-9a0f23633448 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:44.392859 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-79e7f604-dc2c-4ef8-92d8-9a0f23633448 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:44.478126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-79e7f604-dc2c-4ef8-92d8-9a0f23633448 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099287 Sep 05 12:32:44.478726 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 521/1052] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Sep 5 12:32:44 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:45.545795 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-fbe93c3e-6f3a-4990-a21b-310966740af5 req-449f9235-37db-4b3b-8f3d-1ca84f64f703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17707518-9625-4f2a-9c46-a3efa0079962", "tag": "89198988-8838-4912-880d-01b3b244c58d"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:45.555728 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-fbe93c3e-6f3a-4990-a21b-310966740af5 req-449f9235-37db-4b3b-8f3d-1ca84f64f703 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:45.556210 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-fbe93c3e-6f3a-4990-a21b-310966740af5 req-449f9235-37db-4b3b-8f3d-1ca84f64f703 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:45.556650 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-fbe93c3e-6f3a-4990-a21b-310966740af5 req-449f9235-37db-4b3b-8f3d-1ca84f64f703 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:45.568342 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-fbe93c3e-6f3a-4990-a21b-310966740af5 req-449f9235-37db-4b3b-8f3d-1ca84f64f703 service nova] Creating event network-changed:89198988-8838-4912-880d-01b3b244c58d for instance 17707518-9625-4f2a-9c46-a3efa0079962 on hv-cinder-85518 Sep 05 12:32:45.573643 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-fbe93c3e-6f3a-4990-a21b-310966740af5 req-449f9235-37db-4b3b-8f3d-1ca84f64f703 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156065 Sep 05 12:32:45.576848 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 532/1053] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:13.077961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR oslo.messaging._drivers.impl_rabbit [-] [00049363-db07-458c-9e7c-c96217cc2d5b] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 05 12:34:13.078576 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=5 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:13.079277 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=11 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:13.085100 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a259487c-7bd5-4d0d-a7d7-8cda271b4b01 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:13.085593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a259487c-7bd5-4d0d-a7d7-8cda271b4b01 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:13.092036 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a259487c-7bd5-4d0d-a7d7-8cda271b4b01 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:13.092515 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a259487c-7bd5-4d0d-a7d7-8cda271b4b01 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:13.092955 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a259487c-7bd5-4d0d-a7d7-8cda271b4b01 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:13.093639 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a259487c-7bd5-4d0d-a7d7-8cda271b4b01 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:13.094092 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a259487c-7bd5-4d0d-a7d7-8cda271b4b01 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:13.094516 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a259487c-7bd5-4d0d-a7d7-8cda271b4b01 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:13.117498 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a259487c-7bd5-4d0d-a7d7-8cda271b4b01 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962/ips" status: 200 len: 149 microversion: 2.1 time: 0.041399 Sep 05 12:34:13.118050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 522/1054] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Sep 5 12:34:13 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:13.129306 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=3 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:13.130048 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=14 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:13.131355 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:34:13.131547 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Mon Sep 5 12:34:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962/os-volume_attachments (ip 10.222.0.16) !!! Sep 05 12:34:13.132708 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:34:13.132828 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Mon Sep 5 12:34:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962/os-volume_attachments (ip 10.222.0.16) !!! Sep 05 12:34:13.140134 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a5c771c3-ef9a-4260-bac5-18a00d20e950 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50da9cb3-bd4f-4c06-b4bb-abbecf3415be"}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:13.142592 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a5c771c3-ef9a-4260-bac5-18a00d20e950 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:13.154076 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a5c771c3-ef9a-4260-bac5-18a00d20e950 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:13.154558 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a5c771c3-ef9a-4260-bac5-18a00d20e950 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:13.154995 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a5c771c3-ef9a-4260-bac5-18a00d20e950 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:13.155719 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a5c771c3-ef9a-4260-bac5-18a00d20e950 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:13.156178 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a5c771c3-ef9a-4260-bac5-18a00d20e950 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:13.156605 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a5c771c3-ef9a-4260-bac5-18a00d20e950 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:13.330230 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-a5c771c3-ef9a-4260-bac5-18a00d20e950 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] HTTP exception thrown: Invalid volume: volume 50da9cb3-bd4f-4c06-b4bb-abbecf3415be is already attached to instances: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a5c771c3-ef9a-4260-bac5-18a00d20e950 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Request method failure captured: Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: POST /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962/os-volume_attachments HTTP/1.1 Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 74 Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFevbiPOhfWakBg3IVNlM2z9awKnqcWXEXE6jd60IlWvr06bkTobODUMmVlgk4EZARnR8xj6eOknNEMDHft90bVE1X13zu3SJw17J3mnuQG4esDJYolpUwF3G-wm0_7mTBIPn9061RQE0yvRD_YUhaVGIPYeeRpfG_-GH9f1mUHiqs3E Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:34:13.331910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:34:13.333648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d3972b5b8b24e999998d2616531f9e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}] Sep 05 12:34:13.333648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:34:13.333648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:34:13.333648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:34:13.333648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:34:13.333648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:34:13.333648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:34:13.333648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: ee580cfc10dd4536b0709e65e3d23d4d Sep 05 12:34:13.333648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:34:13.333648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Sep 05 12:34:13.333648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {"volumeAttachment": {"volumeId": "50da9cb3-bd4f-4c06-b4bb-abbecf3415be"}} Sep 05 12:34:13.333648 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Invalid volume: volume 50da9cb3-bd4f-4c06-b4bb-abbecf3415be is already attached to instances: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'server_id': '17707518-9625-4f2a-9c46-a3efa0079962', 'body': {'volumeAttachment': {'volumeId': '50da9cb3-bd4f-4c06-b4bb-abbecf3415be'}}} Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 50da9cb3-bd4f-4c06-b4bb-abbecf3415be is already attached to instances: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:13.334751 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 50da9cb3-bd4f-4c06-b4bb-abbecf3415be is already attached to instances: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:13.336372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:13.338033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:13.338033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:34:13.338033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:34:13.338033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 50da9cb3-bd4f-4c06-b4bb-abbecf3415be is already attached to instances: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca Sep 05 12:34:13.338033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:13.338033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a5c771c3-ef9a-4260-bac5-18a00d20e950 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Returning 400 to user: Invalid volume: volume 50da9cb3-bd4f-4c06-b4bb-abbecf3415be is already attached to instances: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:34:13.338033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a5c771c3-ef9a-4260-bac5-18a00d20e950 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "POST /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.206120 Sep 05 12:34:13.338033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 533/1055] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Sep 5 12:34:13 2022] POST /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962/os-volume_attachments => generated 174 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:34:13.342574 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5964313d-8523-4f34-a052-a439a62818bf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:13.342574 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5964313d-8523-4f34-a052-a439a62818bf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:13.348654 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5964313d-8523-4f34-a052-a439a62818bf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:13.349139 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5964313d-8523-4f34-a052-a439a62818bf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:13.349570 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5964313d-8523-4f34-a052-a439a62818bf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:13.350256 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5964313d-8523-4f34-a052-a439a62818bf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:13.350706 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5964313d-8523-4f34-a052-a439a62818bf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:13.351135 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5964313d-8523-4f34-a052-a439a62818bf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:13.376347 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5964313d-8523-4f34-a052-a439a62818bf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Going to try to terminate instance {{(pid=120534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:34:13.451824 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5964313d-8523-4f34-a052-a439a62818bf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 204 len: 0 microversion: 2.1 time: 0.113065 Sep 05 12:34:13.452555 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 523/1056] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:34:13 2022] DELETE /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:34:13.461225 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-d1adffe5-abc6-4829-8871-96b1fb91eb2d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:13.461839 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-d1adffe5-abc6-4829-8871-96b1fb91eb2d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:13.468747 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d1adffe5-abc6-4829-8871-96b1fb91eb2d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:13.469231 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d1adffe5-abc6-4829-8871-96b1fb91eb2d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:13.469667 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d1adffe5-abc6-4829-8871-96b1fb91eb2d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:13.470354 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d1adffe5-abc6-4829-8871-96b1fb91eb2d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:13.470812 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d1adffe5-abc6-4829-8871-96b1fb91eb2d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:13.471240 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-d1adffe5-abc6-4829-8871-96b1fb91eb2d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:13.606522 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-d1adffe5-abc6-4829-8871-96b1fb91eb2d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:13.614275 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-d1adffe5-abc6-4829-8871-96b1fb91eb2d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1682 microversion: 2.1 time: 0.156978 Sep 05 12:34:13.614844 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 534/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:13 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:14.639377 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-af92740d-2284-4f38-936f-92ba914e0236 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:14.640020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-af92740d-2284-4f38-936f-92ba914e0236 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:14.649456 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af92740d-2284-4f38-936f-92ba914e0236 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:14.649941 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af92740d-2284-4f38-936f-92ba914e0236 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:14.650399 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af92740d-2284-4f38-936f-92ba914e0236 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:14.651123 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af92740d-2284-4f38-936f-92ba914e0236 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:14.651608 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af92740d-2284-4f38-936f-92ba914e0236 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:14.652069 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-af92740d-2284-4f38-936f-92ba914e0236 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:14.657480 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO oslo.messaging._drivers.impl_rabbit [-] [00049363-db07-458c-9e7c-c96217cc2d5b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40674. Sep 05 12:34:14.833663 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-af92740d-2284-4f38-936f-92ba914e0236 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:14.841261 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-af92740d-2284-4f38-936f-92ba914e0236 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1682 microversion: 2.1 time: 0.206902 Sep 05 12:34:14.841815 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 524/1058] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:14 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:15.864533 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6cb7e728-5bc9-47da-bb00-c106aab2f275 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:15.865172 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6cb7e728-5bc9-47da-bb00-c106aab2f275 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:15.871436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6cb7e728-5bc9-47da-bb00-c106aab2f275 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:15.871945 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6cb7e728-5bc9-47da-bb00-c106aab2f275 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:15.872375 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6cb7e728-5bc9-47da-bb00-c106aab2f275 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:15.873061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6cb7e728-5bc9-47da-bb00-c106aab2f275 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:15.873512 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6cb7e728-5bc9-47da-bb00-c106aab2f275 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:15.873966 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6cb7e728-5bc9-47da-bb00-c106aab2f275 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:15.983644 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6cb7e728-5bc9-47da-bb00-c106aab2f275 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:15.986757 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-de500cee-7d0a-42ac-81be-1ba1d4d16be1 req-b9403c58-637c-4fce-a379-6ca51cfd7261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17707518-9625-4f2a-9c46-a3efa0079962", "name": "network-vif-deleted", "tag": "89198988-8838-4912-880d-01b3b244c58d"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:15.993227 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6cb7e728-5bc9-47da-bb00-c106aab2f275 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 200 len: 1614 microversion: 2.1 time: 0.132485 Sep 05 12:34:16.007773 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-de500cee-7d0a-42ac-81be-1ba1d4d16be1 req-b9403c58-637c-4fce-a379-6ca51cfd7261 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:16.007773 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-de500cee-7d0a-42ac-81be-1ba1d4d16be1 req-b9403c58-637c-4fce-a379-6ca51cfd7261 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:16.007773 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-de500cee-7d0a-42ac-81be-1ba1d4d16be1 req-b9403c58-637c-4fce-a379-6ca51cfd7261 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:16.008770 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 535/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:15 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 1614 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:16.021000 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-de500cee-7d0a-42ac-81be-1ba1d4d16be1 req-b9403c58-637c-4fce-a379-6ca51cfd7261 service nova] Creating event network-vif-deleted:89198988-8838-4912-880d-01b3b244c58d for instance 17707518-9625-4f2a-9c46-a3efa0079962 on hv-cinder-85518 Sep 05 12:34:16.026730 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-de500cee-7d0a-42ac-81be-1ba1d4d16be1 req-b9403c58-637c-4fce-a379-6ca51cfd7261 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044479 Sep 05 12:34:16.027374 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 525/1060] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:17.020064 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7d6c8f73-cd27-40b7-b958-390819a32a22 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:17.020683 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7d6c8f73-cd27-40b7-b958-390819a32a22 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:17.027610 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7d6c8f73-cd27-40b7-b958-390819a32a22 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:17.028092 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7d6c8f73-cd27-40b7-b958-390819a32a22 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:17.028526 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7d6c8f73-cd27-40b7-b958-390819a32a22 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:17.029207 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7d6c8f73-cd27-40b7-b958-390819a32a22 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:17.029661 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7d6c8f73-cd27-40b7-b958-390819a32a22 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:17.030086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7d6c8f73-cd27-40b7-b958-390819a32a22 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:17.044905 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-7d6c8f73-cd27-40b7-b958-390819a32a22 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] HTTP exception thrown: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7d6c8f73-cd27-40b7-b958-390819a32a22 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Request method failure captured: Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 HTTP/1.1 Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFevbiPOhfWakBg3IVNlM2z9awKnqcWXEXE6jd60IlWvr06bkTobODUMmVlgk4EZARnR8xj6eOknNEMDHft90bVE1X13zu3SJw17J3mnuQG4esDJYolpUwF3G-wm0_7mTBIPn9061RQE0yvRD_YUhaVGIPYeeRpfG_-GH9f1mUHiqs3E Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:34:17.046436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:34:17.048195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d3972b5b8b24e999998d2616531f9e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}] Sep 05 12:34:17.048195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:34:17.048195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:34:17.048195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:34:17.048195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:34:17.048195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:34:17.048195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:34:17.048195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: ee580cfc10dd4536b0709e65e3d23d4d Sep 05 12:34:17.048195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:34:17.048195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:34:17.048195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:34:17.048195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '17707518-9625-4f2a-9c46-a3efa0079962'} Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:34:17.049106 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:34:17.050694 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:17.052278 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7d6c8f73-cd27-40b7-b958-390819a32a22 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Returning 404 to user: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:34:17.052278 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7d6c8f73-cd27-40b7-b958-390819a32a22 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 404 len: 111 microversion: 2.1 time: 0.032102 Sep 05 12:34:17.052278 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 536/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:17 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:34:17.057806 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-dfe56f24-ae0a-4f40-98d5-9178c0f2f342 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '.version_select at 0x7fba4b8ecb80>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:17.077686 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-dfe56f24-ae0a-4f40-98d5-9178c0f2f342 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072467200" status: 202 len: 0 microversion: 2.1 time: 0.024418 Sep 05 12:34:17.078243 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 526/1062] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Sep 5 12:34:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072467200 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:34:17.717092 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ed89a110-7779-4a29-a5f3-3c4eefcd3cfb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:17.717610 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ed89a110-7779-4a29-a5f3-3c4eefcd3cfb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:17.723573 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed89a110-7779-4a29-a5f3-3c4eefcd3cfb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:17.724061 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed89a110-7779-4a29-a5f3-3c4eefcd3cfb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:17.724498 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed89a110-7779-4a29-a5f3-3c4eefcd3cfb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:17.725183 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed89a110-7779-4a29-a5f3-3c4eefcd3cfb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:17.725641 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed89a110-7779-4a29-a5f3-3c4eefcd3cfb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:17.726069 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed89a110-7779-4a29-a5f3-3c4eefcd3cfb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:17.805298 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-ed89a110-7779-4a29-a5f3-3c4eefcd3cfb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lazy-loading 'services' on Instance uuid 9c2c88ae-7231-41ce-89c5-c82c379fd3ca {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:34:17.876719 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ed89a110-7779-4a29-a5f3-3c4eefcd3cfb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca/os-volume_attachments/50da9cb3-bd4f-4c06-b4bb-abbecf3415be" status: 202 len: 0 microversion: 2.1 time: 0.163384 Sep 05 12:34:17.877322 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 537/1063] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Sep 5 12:34:17 2022] DELETE /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca/os-volume_attachments/50da9cb3-bd4f-4c06-b4bb-abbecf3415be => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:34:17.885654 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-0441e0bd-eb8b-4207-a7f6-153b52ebb84d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:17.888191 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-0441e0bd-eb8b-4207-a7f6-153b52ebb84d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:17.895279 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0441e0bd-eb8b-4207-a7f6-153b52ebb84d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:17.895791 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0441e0bd-eb8b-4207-a7f6-153b52ebb84d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:17.896408 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0441e0bd-eb8b-4207-a7f6-153b52ebb84d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:17.897124 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0441e0bd-eb8b-4207-a7f6-153b52ebb84d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:17.897580 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0441e0bd-eb8b-4207-a7f6-153b52ebb84d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:17.898026 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-0441e0bd-eb8b-4207-a7f6-153b52ebb84d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:17.931141 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-0441e0bd-eb8b-4207-a7f6-153b52ebb84d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049414 Sep 05 12:34:17.932381 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 527/1064] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:17 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:18.945703 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ecce7edd-26ad-4049-be9b-689fd5ae8b16 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:18.948763 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ecce7edd-26ad-4049-be9b-689fd5ae8b16 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:18.954971 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ecce7edd-26ad-4049-be9b-689fd5ae8b16 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:18.955456 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ecce7edd-26ad-4049-be9b-689fd5ae8b16 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:18.955996 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ecce7edd-26ad-4049-be9b-689fd5ae8b16 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:18.956692 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ecce7edd-26ad-4049-be9b-689fd5ae8b16 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:18.957148 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ecce7edd-26ad-4049-be9b-689fd5ae8b16 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:18.957584 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ecce7edd-26ad-4049-be9b-689fd5ae8b16 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:18.987846 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ecce7edd-26ad-4049-be9b-689fd5ae8b16 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046965 Sep 05 12:34:18.988425 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 538/1065] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:18 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:34:19.052557 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-69e50094-15e2-4bd3-b4bd-077b3a58aa53 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:19.053082 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-69e50094-15e2-4bd3-b4bd-077b3a58aa53 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:19.059877 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-69e50094-15e2-4bd3-b4bd-077b3a58aa53 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:19.060360 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-69e50094-15e2-4bd3-b4bd-077b3a58aa53 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:19.060795 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-69e50094-15e2-4bd3-b4bd-077b3a58aa53 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:19.061500 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-69e50094-15e2-4bd3-b4bd-077b3a58aa53 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:19.061951 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-69e50094-15e2-4bd3-b4bd-077b3a58aa53 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:19.062372 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-69e50094-15e2-4bd3-b4bd-077b3a58aa53 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:19.087096 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-69e50094-15e2-4bd3-b4bd-077b3a58aa53 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Going to try to terminate instance {{(pid=120534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:34:19.159346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-69e50094-15e2-4bd3-b4bd-077b3a58aa53 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 204 len: 0 microversion: 2.1 time: 0.110178 Sep 05 12:34:19.160367 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 528/1066] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:34:19 2022] DELETE /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:34:19.168396 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-f63eb285-33bc-4122-b534-5d80f06e168a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:19.169005 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-f63eb285-33bc-4122-b534-5d80f06e168a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:19.174863 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f63eb285-33bc-4122-b534-5d80f06e168a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:19.175396 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f63eb285-33bc-4122-b534-5d80f06e168a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:19.175814 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f63eb285-33bc-4122-b534-5d80f06e168a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:19.176502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f63eb285-33bc-4122-b534-5d80f06e168a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:19.176962 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f63eb285-33bc-4122-b534-5d80f06e168a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:19.177388 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-f63eb285-33bc-4122-b534-5d80f06e168a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:19.304504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-f63eb285-33bc-4122-b534-5d80f06e168a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:19.312771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-f63eb285-33bc-4122-b534-5d80f06e168a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1682 microversion: 2.1 time: 0.148224 Sep 05 12:34:19.313334 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 539/1067] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:19 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:20.337236 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-75fe0f78-e2c3-4177-92d0-e85c90748843 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:20.337941 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-75fe0f78-e2c3-4177-92d0-e85c90748843 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:20.344317 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-75fe0f78-e2c3-4177-92d0-e85c90748843 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:20.344801 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-75fe0f78-e2c3-4177-92d0-e85c90748843 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:20.345241 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-75fe0f78-e2c3-4177-92d0-e85c90748843 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:20.345937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-75fe0f78-e2c3-4177-92d0-e85c90748843 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:20.346394 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-75fe0f78-e2c3-4177-92d0-e85c90748843 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:20.346820 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-75fe0f78-e2c3-4177-92d0-e85c90748843 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:20.477412 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-75fe0f78-e2c3-4177-92d0-e85c90748843 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:20.485696 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-75fe0f78-e2c3-4177-92d0-e85c90748843 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1682 microversion: 2.1 time: 0.152681 Sep 05 12:34:20.486260 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 529/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:20 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:21.508635 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-3363f965-28cd-4fcc-a750-c5dba5f3dc9a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:21.509271 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3363f965-28cd-4fcc-a750-c5dba5f3dc9a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:21.516123 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3363f965-28cd-4fcc-a750-c5dba5f3dc9a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:21.516613 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3363f965-28cd-4fcc-a750-c5dba5f3dc9a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:21.517051 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3363f965-28cd-4fcc-a750-c5dba5f3dc9a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:21.517744 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3363f965-28cd-4fcc-a750-c5dba5f3dc9a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:21.518199 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3363f965-28cd-4fcc-a750-c5dba5f3dc9a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:21.518629 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3363f965-28cd-4fcc-a750-c5dba5f3dc9a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:21.783707 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-3363f965-28cd-4fcc-a750-c5dba5f3dc9a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:21.792107 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-3363f965-28cd-4fcc-a750-c5dba5f3dc9a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1682 microversion: 2.1 time: 0.287279 Sep 05 12:34:21.792672 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 540/1069] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:21 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1682 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:22.218440 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-c883f163-fac1-4017-8fbc-6fa23a9c79b5 req-6563ccfc-998f-4a90-8d11-fb0b3d82e3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2c88ae-7231-41ce-89c5-c82c379fd3ca", "name": "network-vif-deleted", "tag": "f195a195-8eca-4b03-b45b-5519e70a504a"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:22.230411 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-c883f163-fac1-4017-8fbc-6fa23a9c79b5 req-6563ccfc-998f-4a90-8d11-fb0b3d82e3df service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:22.230810 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-c883f163-fac1-4017-8fbc-6fa23a9c79b5 req-6563ccfc-998f-4a90-8d11-fb0b3d82e3df service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:22.231244 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-c883f163-fac1-4017-8fbc-6fa23a9c79b5 req-6563ccfc-998f-4a90-8d11-fb0b3d82e3df service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:22.244857 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-c883f163-fac1-4017-8fbc-6fa23a9c79b5 req-6563ccfc-998f-4a90-8d11-fb0b3d82e3df service nova] Creating event network-vif-deleted:f195a195-8eca-4b03-b45b-5519e70a504a for instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca on hv-cinder-85518 Sep 05 12:34:22.250194 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-c883f163-fac1-4017-8fbc-6fa23a9c79b5 req-6563ccfc-998f-4a90-8d11-fb0b3d82e3df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035380 Sep 05 12:34:22.253680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 530/1070] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:22.815998 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ebae59fc-75dd-4e13-8b58-786adbca9d02 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:22.817235 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ebae59fc-75dd-4e13-8b58-786adbca9d02 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:22.824491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebae59fc-75dd-4e13-8b58-786adbca9d02 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:22.824975 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebae59fc-75dd-4e13-8b58-786adbca9d02 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:22.825404 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebae59fc-75dd-4e13-8b58-786adbca9d02 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:22.826145 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebae59fc-75dd-4e13-8b58-786adbca9d02 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:22.826774 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebae59fc-75dd-4e13-8b58-786adbca9d02 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:22.827410 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebae59fc-75dd-4e13-8b58-786adbca9d02 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:22.860046 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebae59fc-75dd-4e13-8b58-786adbca9d02 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:22.860792 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebae59fc-75dd-4e13-8b58-786adbca9d02 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:22.861404 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ebae59fc-75dd-4e13-8b58-786adbca9d02 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:22.861855 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-ebae59fc-75dd-4e13-8b58-786adbca9d02 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lazy-loading 'fault' on Instance uuid 9c2c88ae-7231-41ce-89c5-c82c379fd3ca {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:34:22.904082 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ebae59fc-75dd-4e13-8b58-786adbca9d02 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:22.911147 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ebae59fc-75dd-4e13-8b58-786adbca9d02 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 200 len: 1332 microversion: 2.1 time: 0.098980 Sep 05 12:34:22.911768 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 541/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:22 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:23.936032 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-050d42d5-d5e4-4f13-92fb-49850df40319 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:23.936743 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-050d42d5-d5e4-4f13-92fb-49850df40319 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:23.942784 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-050d42d5-d5e4-4f13-92fb-49850df40319 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:23.943270 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-050d42d5-d5e4-4f13-92fb-49850df40319 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:23.943741 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-050d42d5-d5e4-4f13-92fb-49850df40319 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:23.944440 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-050d42d5-d5e4-4f13-92fb-49850df40319 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:23.944898 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-050d42d5-d5e4-4f13-92fb-49850df40319 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:23.945330 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-050d42d5-d5e4-4f13-92fb-49850df40319 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:23.959279 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-050d42d5-d5e4-4f13-92fb-49850df40319 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] HTTP exception thrown: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-050d42d5-d5e4-4f13-92fb-49850df40319 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Request method failure captured: Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca HTTP/1.1 Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFevbiPOhfWakBg3IVNlM2z9awKnqcWXEXE6jd60IlWvr06bkTobODUMmVlgk4EZARnR8xj6eOknNEMDHft90bVE1X13zu3SJw17J3mnuQG4esDJYolpUwF3G-wm0_7mTBIPn9061RQE0yvRD_YUhaVGIPYeeRpfG_-GH9f1mUHiqs3E Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:34:23.960945 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:34:23.962558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d3972b5b8b24e999998d2616531f9e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}] Sep 05 12:34:23.962558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:34:23.962558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:34:23.962558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:34:23.962558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:34:23.962558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:34:23.962558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:34:23.962558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: ee580cfc10dd4536b0709e65e3d23d4d Sep 05 12:34:23.962558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:34:23.962558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:34:23.962558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:34:23.962558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '9c2c88ae-7231-41ce-89c5-c82c379fd3ca'} Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:34:23.964252 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:34:23.965785 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:23.967301 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-050d42d5-d5e4-4f13-92fb-49850df40319 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Returning 404 to user: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:34:23.967301 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-050d42d5-d5e4-4f13-92fb-49850df40319 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 404 len: 111 microversion: 2.1 time: 0.031399 Sep 05 12:34:23.967301 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 531/1072] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:23 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:34:23.971918 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1fa69432-238d-4df7-aad3-38c5ecdea619 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '.version_select at 0x7fba4f1ea8b0>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:23.994727 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1fa69432-238d-4df7-aad3-38c5ecdea619 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300991841" status: 202 len: 0 microversion: 2.1 time: 0.026637 Sep 05 12:34:23.995283 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 542/1073] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Sep 5 12:34:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300991841 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:34:24.592516 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-07135d1a-7f99-4fdb-a627-f146ecf376b2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Action: 'create', calling method: .version_select at 0x7fba4ba9c820>, body: {"keypair": {"name": "tempest-keypair-757862119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4wa0ma+qWKfkFx7m7daK9kTHaOgoQydF3qdkohGBaKw59pxDK0PgXvLJ8FnxrYwnxIU/WecCG9yIbfWzKusoIQP6eaL6witTP2St6vln/6WFeJR7uB6VV703boUmgAYg=="}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:24.607453 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-07135d1a-7f99-4fdb-a627-f146ecf376b2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'key_pairs'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:34:24.611212 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-07135d1a-7f99-4fdb-a627-f146ecf376b2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for user ee580cfc10dd4536b0709e65e3d23d4d and project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'key_pairs'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:34:24.634158 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-07135d1a-7f99-4fdb-a627-f146ecf376b2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045949 Sep 05 12:34:24.634673 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 532/1074] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Sep 5 12:34:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:25.815883 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-354036280", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49732eeb-e082-4048-831f-1af5d3375981"}], "security_groups": [{"name": "tempest-securitygroup--976502635"}], "key_name": "tempest-keypair-757862119", "user_data": "}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:25.916655 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.network.neutron [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] validate_networks() for [('49732eeb-e082-4048-831f-1af5d3375981', None, None, None, None, None)] {{(pid=120535) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:34:26.277126 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Flavor limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:34:26.277497 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Image limits 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:34:26.278006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Flavor pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:34:26.278436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Image pref 0:0:0 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:34:26.278845 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.virt.hardware [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:34:26.287864 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:26.288378 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:26.288812 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:26.289535 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:26.289986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:26.290410 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:26.307750 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:34:26.311643 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for user ee580cfc10dd4536b0709e65e3d23d4d and project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'instances', 'cores', 'ram'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:34:26.322481 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Going to run 1 instances... {{(pid=120535) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:34:26.324758 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:34:26.375929 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-3b175ec3-4842-41d8-bc46-8927afda1647 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.563975 Sep 05 12:34:26.376568 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 543/1075] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:34:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:34:26.388375 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1d4a9100-b77b-46e5-8935-350388e60e91 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:26.388994 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1d4a9100-b77b-46e5-8935-350388e60e91 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:26.445347 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1d4a9100-b77b-46e5-8935-350388e60e91 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:26.452142 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1d4a9100-b77b-46e5-8935-350388e60e91 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1240 microversion: 2.1 time: 0.068326 Sep 05 12:34:26.452702 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 533/1076] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:26 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:27.475138 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-02ad13ba-d708-40da-891b-822a31e760ea tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:27.476457 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-02ad13ba-d708-40da-891b-822a31e760ea tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:27.483507 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02ad13ba-d708-40da-891b-822a31e760ea tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:27.484383 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02ad13ba-d708-40da-891b-822a31e760ea tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:27.484886 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02ad13ba-d708-40da-891b-822a31e760ea tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:27.485813 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02ad13ba-d708-40da-891b-822a31e760ea tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:27.487398 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02ad13ba-d708-40da-891b-822a31e760ea tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:27.488223 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02ad13ba-d708-40da-891b-822a31e760ea tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:27.565525 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-02ad13ba-d708-40da-891b-822a31e760ea tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:27.573504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-02ad13ba-d708-40da-891b-822a31e760ea tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1300 microversion: 2.1 time: 0.102272 Sep 05 12:34:27.574063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 544/1077] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:27 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:28.596632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-1d8ec6d8-9e94-44bf-ba6c-97cb68611c98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:28.597250 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-1d8ec6d8-9e94-44bf-ba6c-97cb68611c98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:28.604176 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1d8ec6d8-9e94-44bf-ba6c-97cb68611c98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:28.604671 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1d8ec6d8-9e94-44bf-ba6c-97cb68611c98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:28.605090 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1d8ec6d8-9e94-44bf-ba6c-97cb68611c98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:28.605802 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1d8ec6d8-9e94-44bf-ba6c-97cb68611c98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:28.606262 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1d8ec6d8-9e94-44bf-ba6c-97cb68611c98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:28.606693 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-1d8ec6d8-9e94-44bf-ba6c-97cb68611c98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:28.747674 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-1d8ec6d8-9e94-44bf-ba6c-97cb68611c98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:28.755783 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-1d8ec6d8-9e94-44bf-ba6c-97cb68611c98 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1365 microversion: 2.1 time: 0.163306 Sep 05 12:34:28.756347 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 534/1078] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:28 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:29.256042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-0c7a1620-ad66-492e-8037-448d151dd4ae req-432c2176-ae7a-4557-a9b7-532a6c4ea3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27958846-c92c-487b-a866-83591259f73b", "tag": "919fcbc7-3803-4a18-b258-517be0763bec"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:29.266851 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-0c7a1620-ad66-492e-8037-448d151dd4ae req-432c2176-ae7a-4557-a9b7-532a6c4ea3d7 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:29.267350 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-0c7a1620-ad66-492e-8037-448d151dd4ae req-432c2176-ae7a-4557-a9b7-532a6c4ea3d7 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:29.267916 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-0c7a1620-ad66-492e-8037-448d151dd4ae req-432c2176-ae7a-4557-a9b7-532a6c4ea3d7 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:29.279470 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-0c7a1620-ad66-492e-8037-448d151dd4ae req-432c2176-ae7a-4557-a9b7-532a6c4ea3d7 service nova] Creating event network-changed:919fcbc7-3803-4a18-b258-517be0763bec for instance 27958846-c92c-487b-a866-83591259f73b on hv-cinder-85518 Sep 05 12:34:29.284639 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-0c7a1620-ad66-492e-8037-448d151dd4ae req-432c2176-ae7a-4557-a9b7-532a6c4ea3d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032404 Sep 05 12:34:29.285217 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 545/1079] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:29.779396 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-de1df863-6db4-48f0-9801-641bbf91be10 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:29.780057 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-de1df863-6db4-48f0-9801-641bbf91be10 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:29.786421 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de1df863-6db4-48f0-9801-641bbf91be10 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:29.786905 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de1df863-6db4-48f0-9801-641bbf91be10 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:29.787349 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de1df863-6db4-48f0-9801-641bbf91be10 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:29.788070 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de1df863-6db4-48f0-9801-641bbf91be10 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:29.788530 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de1df863-6db4-48f0-9801-641bbf91be10 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:29.788966 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-de1df863-6db4-48f0-9801-641bbf91be10 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:29.915592 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-de1df863-6db4-48f0-9801-641bbf91be10 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:29.923265 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-de1df863-6db4-48f0-9801-641bbf91be10 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1365 microversion: 2.1 time: 0.148360 Sep 05 12:34:29.923865 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 535/1080] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:29 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:30.945675 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0b5cf366-80da-4f17-8d1a-d076dbe25fcb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:30.946379 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0b5cf366-80da-4f17-8d1a-d076dbe25fcb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:30.953625 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b5cf366-80da-4f17-8d1a-d076dbe25fcb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:30.954099 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b5cf366-80da-4f17-8d1a-d076dbe25fcb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:30.954531 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b5cf366-80da-4f17-8d1a-d076dbe25fcb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:30.955208 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b5cf366-80da-4f17-8d1a-d076dbe25fcb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:30.955702 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b5cf366-80da-4f17-8d1a-d076dbe25fcb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:30.956128 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0b5cf366-80da-4f17-8d1a-d076dbe25fcb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:31.083656 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-0b5cf366-80da-4f17-8d1a-d076dbe25fcb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:31.091232 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0b5cf366-80da-4f17-8d1a-d076dbe25fcb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1365 microversion: 2.1 time: 0.149844 Sep 05 12:34:31.091823 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 546/1081] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:30 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:32.113599 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-6278ffa1-9249-4d8c-8f4b-d799782f51f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:32.114212 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-6278ffa1-9249-4d8c-8f4b-d799782f51f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:32.120478 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6278ffa1-9249-4d8c-8f4b-d799782f51f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:32.120956 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6278ffa1-9249-4d8c-8f4b-d799782f51f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:32.121385 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6278ffa1-9249-4d8c-8f4b-d799782f51f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:32.122104 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6278ffa1-9249-4d8c-8f4b-d799782f51f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:32.122553 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6278ffa1-9249-4d8c-8f4b-d799782f51f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:32.122974 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-6278ffa1-9249-4d8c-8f4b-d799782f51f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:32.250950 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-6278ffa1-9249-4d8c-8f4b-d799782f51f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:32.258893 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-6278ffa1-9249-4d8c-8f4b-d799782f51f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1365 microversion: 2.1 time: 0.149138 Sep 05 12:34:32.259451 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 536/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:32 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:33.282455 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7f78b29d-997c-40db-8a74-fdf7f879045c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:33.283073 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7f78b29d-997c-40db-8a74-fdf7f879045c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:33.289578 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f78b29d-997c-40db-8a74-fdf7f879045c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:33.290056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f78b29d-997c-40db-8a74-fdf7f879045c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:33.290492 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f78b29d-997c-40db-8a74-fdf7f879045c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:33.291868 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f78b29d-997c-40db-8a74-fdf7f879045c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:33.292330 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f78b29d-997c-40db-8a74-fdf7f879045c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:33.292785 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7f78b29d-997c-40db-8a74-fdf7f879045c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:33.418631 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-7f78b29d-997c-40db-8a74-fdf7f879045c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:33.426186 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7f78b29d-997c-40db-8a74-fdf7f879045c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1365 microversion: 2.1 time: 0.147605 Sep 05 12:34:33.426744 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 547/1083] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:33 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:34.448792 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8f6749e8-a070-4048-876d-3e610194755a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:34.449398 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-8f6749e8-a070-4048-876d-3e610194755a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:34.456130 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8f6749e8-a070-4048-876d-3e610194755a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:34.456620 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8f6749e8-a070-4048-876d-3e610194755a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:34.457058 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8f6749e8-a070-4048-876d-3e610194755a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:34.457759 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8f6749e8-a070-4048-876d-3e610194755a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:34.458220 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8f6749e8-a070-4048-876d-3e610194755a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:34.458653 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8f6749e8-a070-4048-876d-3e610194755a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:34.585971 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8f6749e8-a070-4048-876d-3e610194755a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:34.593574 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8f6749e8-a070-4048-876d-3e610194755a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1365 microversion: 2.1 time: 0.148631 Sep 05 12:34:34.594127 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 537/1084] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:34 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:35.617067 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6f28f834-eeca-477d-b66d-2d7f7f3e318c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:35.617681 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6f28f834-eeca-477d-b66d-2d7f7f3e318c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:35.624472 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f28f834-eeca-477d-b66d-2d7f7f3e318c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:35.624947 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f28f834-eeca-477d-b66d-2d7f7f3e318c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:35.625373 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f28f834-eeca-477d-b66d-2d7f7f3e318c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:35.626049 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f28f834-eeca-477d-b66d-2d7f7f3e318c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:35.626528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f28f834-eeca-477d-b66d-2d7f7f3e318c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:35.626947 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6f28f834-eeca-477d-b66d-2d7f7f3e318c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:35.761801 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6f28f834-eeca-477d-b66d-2d7f7f3e318c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:35.770247 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6f28f834-eeca-477d-b66d-2d7f7f3e318c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1365 microversion: 2.1 time: 0.157418 Sep 05 12:34:35.770811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 548/1085] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:35 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:36.175256 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-6400e21c-70f7-4eec-bd46-1fdffe801a8c req-223d47a3-511a-4ea2-bcd7-805815c186b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27958846-c92c-487b-a866-83591259f73b", "name": "network-vif-plugged", "status": "completed", "tag": "919fcbc7-3803-4a18-b258-517be0763bec"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:36.186030 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6400e21c-70f7-4eec-bd46-1fdffe801a8c req-223d47a3-511a-4ea2-bcd7-805815c186b4 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:36.186679 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6400e21c-70f7-4eec-bd46-1fdffe801a8c req-223d47a3-511a-4ea2-bcd7-805815c186b4 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:36.187071 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6400e21c-70f7-4eec-bd46-1fdffe801a8c req-223d47a3-511a-4ea2-bcd7-805815c186b4 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:36.198133 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-6400e21c-70f7-4eec-bd46-1fdffe801a8c req-223d47a3-511a-4ea2-bcd7-805815c186b4 service nova] Creating event network-vif-plugged:919fcbc7-3803-4a18-b258-517be0763bec for instance 27958846-c92c-487b-a866-83591259f73b on hv-cinder-85518 Sep 05 12:34:36.203086 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-6400e21c-70f7-4eec-bd46-1fdffe801a8c req-223d47a3-511a-4ea2-bcd7-805815c186b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031725 Sep 05 12:34:36.204027 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 538/1086] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:36.792471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-066df6aa-9f01-48e1-8e37-99e4ad3438db tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:36.793078 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-066df6aa-9f01-48e1-8e37-99e4ad3438db tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:36.795092 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=2 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:36.796125 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=6 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:36.802126 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-066df6aa-9f01-48e1-8e37-99e4ad3438db tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:36.802601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-066df6aa-9f01-48e1-8e37-99e4ad3438db tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:36.803029 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-066df6aa-9f01-48e1-8e37-99e4ad3438db tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:36.803737 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-066df6aa-9f01-48e1-8e37-99e4ad3438db tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:36.804184 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-066df6aa-9f01-48e1-8e37-99e4ad3438db tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:36.804634 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-066df6aa-9f01-48e1-8e37-99e4ad3438db tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:37.012708 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-066df6aa-9f01-48e1-8e37-99e4ad3438db tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:37.020520 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-066df6aa-9f01-48e1-8e37-99e4ad3438db tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1365 microversion: 2.1 time: 0.231871 Sep 05 12:34:37.022240 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 549/1087] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:36 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:37.156255 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=6 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:37.160651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5b5b18c7-10e1-4ad0-bc0d-bde5cc840421 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:37.161270 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5b5b18c7-10e1-4ad0-bc0d-bde5cc840421 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:37.168033 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5b5b18c7-10e1-4ad0-bc0d-bde5cc840421 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:37.168455 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5b5b18c7-10e1-4ad0-bc0d-bde5cc840421 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:37.168892 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5b5b18c7-10e1-4ad0-bc0d-bde5cc840421 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:37.169192 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-c951aeb0-dc7f-4822-88e7-4d29f121d620 req-68dec246-6b22-4b2a-99a3-6998797ac093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7978ec-32b8-4e95-b4a2-924a1ef4d628", "tag": "9fa9a559-8f73-41cc-ad0f-fd13ddc4d5f2"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:37.169585 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5b5b18c7-10e1-4ad0-bc0d-bde5cc840421 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:37.170044 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5b5b18c7-10e1-4ad0-bc0d-bde5cc840421 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:37.170474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5b5b18c7-10e1-4ad0-bc0d-bde5cc840421 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:37.178633 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-c951aeb0-dc7f-4822-88e7-4d29f121d620 req-68dec246-6b22-4b2a-99a3-6998797ac093 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:37.179134 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-c951aeb0-dc7f-4822-88e7-4d29f121d620 req-68dec246-6b22-4b2a-99a3-6998797ac093 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:37.179920 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-c951aeb0-dc7f-4822-88e7-4d29f121d620 req-68dec246-6b22-4b2a-99a3-6998797ac093 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:37.193685 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-c951aeb0-dc7f-4822-88e7-4d29f121d620 req-68dec246-6b22-4b2a-99a3-6998797ac093 service nova] Creating event network-changed:9fa9a559-8f73-41cc-ad0f-fd13ddc4d5f2 for instance 5a7978ec-32b8-4e95-b4a2-924a1ef4d628 on hv-cinder-85518 Sep 05 12:34:37.196977 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5b5b18c7-10e1-4ad0-bc0d-bde5cc840421 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Going to try to terminate instance {{(pid=120534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:34:37.201539 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-c951aeb0-dc7f-4822-88e7-4d29f121d620 req-68dec246-6b22-4b2a-99a3-6998797ac093 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036001 Sep 05 12:34:37.202177 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 550/1088] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:37.244838 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:37.277777 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5b5b18c7-10e1-4ad0-bc0d-bde5cc840421 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 204 len: 0 microversion: 2.1 time: 0.122257 Sep 05 12:34:37.278368 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 539/1089] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:34:37 2022] DELETE /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:34:37.286904 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2eed223d-82b0-432f-8261-e0a1617234fa tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:37.287635 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2eed223d-82b0-432f-8261-e0a1617234fa tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:37.294168 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2eed223d-82b0-432f-8261-e0a1617234fa tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:37.294643 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2eed223d-82b0-432f-8261-e0a1617234fa tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:37.295068 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2eed223d-82b0-432f-8261-e0a1617234fa tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:37.295803 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2eed223d-82b0-432f-8261-e0a1617234fa tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:37.296252 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2eed223d-82b0-432f-8261-e0a1617234fa tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:37.296668 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2eed223d-82b0-432f-8261-e0a1617234fa tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:37.433535 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2eed223d-82b0-432f-8261-e0a1617234fa tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:37.441230 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2eed223d-82b0-432f-8261-e0a1617234fa tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1577 microversion: 2.1 time: 0.158496 Sep 05 12:34:37.441788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 551/1090] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:37 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:38.043392 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a00dc8ec-e2d2-44b8-be55-aa7bc7375637 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:38.044141 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a00dc8ec-e2d2-44b8-be55-aa7bc7375637 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:38.050288 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a00dc8ec-e2d2-44b8-be55-aa7bc7375637 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:38.050778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a00dc8ec-e2d2-44b8-be55-aa7bc7375637 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:38.051219 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a00dc8ec-e2d2-44b8-be55-aa7bc7375637 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:38.051961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a00dc8ec-e2d2-44b8-be55-aa7bc7375637 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:38.052424 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a00dc8ec-e2d2-44b8-be55-aa7bc7375637 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:38.052862 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a00dc8ec-e2d2-44b8-be55-aa7bc7375637 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:38.186115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a00dc8ec-e2d2-44b8-be55-aa7bc7375637 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:38.194648 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a00dc8ec-e2d2-44b8-be55-aa7bc7375637 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1365 microversion: 2.1 time: 0.156127 Sep 05 12:34:38.195296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 540/1091] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:38 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:38.465982 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-3e7b9fb9-2c45-4c9a-890d-34303cac80c7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:38.466727 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3e7b9fb9-2c45-4c9a-890d-34303cac80c7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:38.473279 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3e7b9fb9-2c45-4c9a-890d-34303cac80c7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:38.473754 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3e7b9fb9-2c45-4c9a-890d-34303cac80c7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:38.474187 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3e7b9fb9-2c45-4c9a-890d-34303cac80c7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:38.474873 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3e7b9fb9-2c45-4c9a-890d-34303cac80c7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:38.475326 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3e7b9fb9-2c45-4c9a-890d-34303cac80c7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:38.475779 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3e7b9fb9-2c45-4c9a-890d-34303cac80c7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:38.479982 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:38.603511 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-3e7b9fb9-2c45-4c9a-890d-34303cac80c7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:38.611203 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-3e7b9fb9-2c45-4c9a-890d-34303cac80c7 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1577 microversion: 2.1 time: 0.149099 Sep 05 12:34:38.611925 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 552/1092] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:38 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:39.218507 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2d1de913-7240-4cc3-8348-ca6164a3393b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:39.219045 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2d1de913-7240-4cc3-8348-ca6164a3393b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:39.225440 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2d1de913-7240-4cc3-8348-ca6164a3393b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:39.225920 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2d1de913-7240-4cc3-8348-ca6164a3393b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:39.226358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2d1de913-7240-4cc3-8348-ca6164a3393b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:39.227043 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2d1de913-7240-4cc3-8348-ca6164a3393b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:39.227499 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2d1de913-7240-4cc3-8348-ca6164a3393b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:39.227952 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2d1de913-7240-4cc3-8348-ca6164a3393b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:39.364498 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2d1de913-7240-4cc3-8348-ca6164a3393b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:39.372355 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2d1de913-7240-4cc3-8348-ca6164a3393b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1556 microversion: 2.1 time: 0.157757 Sep 05 12:34:39.373266 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 541/1093] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:39 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:39.394323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-cc94c404-630c-445e-80bb-bd25c76bc8b5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:39.395068 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-cc94c404-630c-445e-80bb-bd25c76bc8b5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:39.401450 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cc94c404-630c-445e-80bb-bd25c76bc8b5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:39.401920 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cc94c404-630c-445e-80bb-bd25c76bc8b5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:39.402348 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cc94c404-630c-445e-80bb-bd25c76bc8b5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:39.403027 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cc94c404-630c-445e-80bb-bd25c76bc8b5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:39.403473 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cc94c404-630c-445e-80bb-bd25c76bc8b5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:39.403913 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-cc94c404-630c-445e-80bb-bd25c76bc8b5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:39.480090 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-cc94c404-630c-445e-80bb-bd25c76bc8b5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089509 Sep 05 12:34:39.480671 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 553/1094] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Sep 5 12:34:39 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:39.635910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b4f0097e-8a69-4163-a07b-7521166fcc0a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:39.636525 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b4f0097e-8a69-4163-a07b-7521166fcc0a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:39.642357 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b4f0097e-8a69-4163-a07b-7521166fcc0a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:39.642837 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b4f0097e-8a69-4163-a07b-7521166fcc0a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:39.643274 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b4f0097e-8a69-4163-a07b-7521166fcc0a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:39.643993 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b4f0097e-8a69-4163-a07b-7521166fcc0a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:39.644706 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b4f0097e-8a69-4163-a07b-7521166fcc0a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:39.645134 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b4f0097e-8a69-4163-a07b-7521166fcc0a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:39.780483 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-b4f0097e-8a69-4163-a07b-7521166fcc0a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:39.788673 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b4f0097e-8a69-4163-a07b-7521166fcc0a tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1577 microversion: 2.1 time: 0.157120 Sep 05 12:34:39.789247 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 542/1095] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:39 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:40.812332 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-dce15a56-8457-425b-9ad4-e8e9c6658cda tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:40.813345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-dce15a56-8457-425b-9ad4-e8e9c6658cda tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:40.818869 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dce15a56-8457-425b-9ad4-e8e9c6658cda tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:40.819351 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dce15a56-8457-425b-9ad4-e8e9c6658cda tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:40.819891 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dce15a56-8457-425b-9ad4-e8e9c6658cda tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:40.820592 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dce15a56-8457-425b-9ad4-e8e9c6658cda tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:40.821042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dce15a56-8457-425b-9ad4-e8e9c6658cda tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:40.821464 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-dce15a56-8457-425b-9ad4-e8e9c6658cda tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:41.093324 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-dce15a56-8457-425b-9ad4-e8e9c6658cda tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:41.101219 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-dce15a56-8457-425b-9ad4-e8e9c6658cda tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1458 microversion: 2.1 time: 0.293315 Sep 05 12:34:41.102033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 554/1096] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:40 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1458 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:41.260874 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-ac2bdf2d-20ae-4bfa-b36b-4066e7501f48 req-af258fd7-446c-4092-a2cb-c551c57b4e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7978ec-32b8-4e95-b4a2-924a1ef4d628", "name": "network-vif-deleted", "tag": "9fa9a559-8f73-41cc-ad0f-fd13ddc4d5f2"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:41.272627 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-ac2bdf2d-20ae-4bfa-b36b-4066e7501f48 req-af258fd7-446c-4092-a2cb-c551c57b4e60 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:41.273112 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-ac2bdf2d-20ae-4bfa-b36b-4066e7501f48 req-af258fd7-446c-4092-a2cb-c551c57b4e60 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:41.273549 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-ac2bdf2d-20ae-4bfa-b36b-4066e7501f48 req-af258fd7-446c-4092-a2cb-c551c57b4e60 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:41.286706 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-ac2bdf2d-20ae-4bfa-b36b-4066e7501f48 req-af258fd7-446c-4092-a2cb-c551c57b4e60 service nova] Creating event network-vif-deleted:9fa9a559-8f73-41cc-ad0f-fd13ddc4d5f2 for instance 5a7978ec-32b8-4e95-b4a2-924a1ef4d628 on hv-cinder-85518 Sep 05 12:34:41.293708 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-ac2bdf2d-20ae-4bfa-b36b-4066e7501f48 req-af258fd7-446c-4092-a2cb-c551c57b4e60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036522 Sep 05 12:34:41.294346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 543/1097] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:42.135012 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e9b71586-b3cb-412b-a482-6bba3a652740 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:42.136197 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e9b71586-b3cb-412b-a482-6bba3a652740 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:42.143402 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9b71586-b3cb-412b-a482-6bba3a652740 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:42.144268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9b71586-b3cb-412b-a482-6bba3a652740 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:42.145333 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9b71586-b3cb-412b-a482-6bba3a652740 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:42.146273 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9b71586-b3cb-412b-a482-6bba3a652740 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:42.146835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9b71586-b3cb-412b-a482-6bba3a652740 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:42.147415 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9b71586-b3cb-412b-a482-6bba3a652740 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:42.182863 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9b71586-b3cb-412b-a482-6bba3a652740 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:42.183681 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9b71586-b3cb-412b-a482-6bba3a652740 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:42.184323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e9b71586-b3cb-412b-a482-6bba3a652740 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:42.184918 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-e9b71586-b3cb-412b-a482-6bba3a652740 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lazy-loading 'fault' on Instance uuid 5a7978ec-32b8-4e95-b4a2-924a1ef4d628 {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:34:42.233961 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-e9b71586-b3cb-412b-a482-6bba3a652740 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:42.242619 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e9b71586-b3cb-412b-a482-6bba3a652740 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 200 len: 1184 microversion: 2.1 time: 0.111971 Sep 05 12:34:42.247753 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 555/1098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:42 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 1184 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:43.267147 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-28a5ff3b-218c-4072-bf41-3a9c83b201eb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:43.267875 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-28a5ff3b-218c-4072-bf41-3a9c83b201eb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 5a7978ec-32b8-4e95-b4a2-924a1ef4d628] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:43.270562 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:43.277008 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-28a5ff3b-218c-4072-bf41-3a9c83b201eb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:43.277494 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-28a5ff3b-218c-4072-bf41-3a9c83b201eb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:43.277940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-28a5ff3b-218c-4072-bf41-3a9c83b201eb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:43.278633 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-28a5ff3b-218c-4072-bf41-3a9c83b201eb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:43.279089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-28a5ff3b-218c-4072-bf41-3a9c83b201eb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:43.279517 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-28a5ff3b-218c-4072-bf41-3a9c83b201eb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:43.294926 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-28a5ff3b-218c-4072-bf41-3a9c83b201eb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] HTTP exception thrown: Instance 5a7978ec-32b8-4e95-b4a2-924a1ef4d628 could not be found. Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-28a5ff3b-218c-4072-bf41-3a9c83b201eb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Request method failure captured: Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 HTTP/1.1 Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFerAZFsqYnyZnhqd68bLariOc-rXOkOi_rdB1cwlJU9qZpX2BFsWpEMzwXop-4f0E0zKv_r5THH5RksKaEe3kTPHDcyoDvRl8kwDAwJ5Y116h0AM82sJkpPukkrguMrZDjFnD-Ucz4skuXw8IeyKoCPkLcfYLThvXuFJUwxXrnph9nI Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 4d5cb05cfc60481fa4144ee7b077ca4f Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:34:43.296758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:34:43.298272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d5cb05cfc60481fa4144ee7b077ca4f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d5cb05cfc60481fa4144ee7b077ca4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d5cb05cfc60481fa4144ee7b077ca4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d5cb05cfc60481fa4144ee7b077ca4f"}]}] Sep 05 12:34:43.298272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:34:43.298272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 4d5cb05cfc60481fa4144ee7b077ca4f Sep 05 12:34:43.298272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:34:43.298272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-TestVolumeBootPattern-1174845777-project Sep 05 12:34:43.298272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:34:43.298272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:34:43.298272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: ebd8a00f21344c7990ffe1a7ff2986ef Sep 05 12:34:43.298272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-TestVolumeBootPattern-1174845777-project Sep 05 12:34:43.298272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:34:43.298272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 5a7978ec-32b8-4e95-b4a2-924a1ef4d628 could not be found. Sep 05 12:34:43.298272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '5a7978ec-32b8-4e95-b4a2-924a1ef4d628'} Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7978ec-32b8-4e95-b4a2-924a1ef4d628 could not be found. Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:34:43.299115 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7978ec-32b8-4e95-b4a2-924a1ef4d628 could not be found. Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7978ec-32b8-4e95-b4a2-924a1ef4d628 could not be found. Sep 05 12:34:43.300647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:43.302286 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-28a5ff3b-218c-4072-bf41-3a9c83b201eb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Returning 404 to user: Instance 5a7978ec-32b8-4e95-b4a2-924a1ef4d628 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:34:43.302286 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-28a5ff3b-218c-4072-bf41-3a9c83b201eb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628" status: 404 len: 111 microversion: 2.1 time: 0.035251 Sep 05 12:34:43.302286 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 544/1099] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:43 2022] GET /compute/v2.1/servers/5a7978ec-32b8-4e95-b4a2-924a1ef4d628 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:34:43.312867 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-cef300b3-1391-4a72-be97-011e5740e381 req-c6763638-4d68-4524-b9e5-8d6911dc1744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27958846-c92c-487b-a866-83591259f73b", "tag": "919fcbc7-3803-4a18-b258-517be0763bec"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:43.318199 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:43.323761 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-cef300b3-1391-4a72-be97-011e5740e381 req-c6763638-4d68-4524-b9e5-8d6911dc1744 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:43.324242 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-cef300b3-1391-4a72-be97-011e5740e381 req-c6763638-4d68-4524-b9e5-8d6911dc1744 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:43.324677 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-cef300b3-1391-4a72-be97-011e5740e381 req-c6763638-4d68-4524-b9e5-8d6911dc1744 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:43.336799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-cef300b3-1391-4a72-be97-011e5740e381 req-c6763638-4d68-4524-b9e5-8d6911dc1744 service nova] Creating event network-changed:919fcbc7-3803-4a18-b258-517be0763bec for instance 27958846-c92c-487b-a866-83591259f73b on hv-cinder-85518 Sep 05 12:34:43.341587 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-cef300b3-1391-4a72-be97-011e5740e381 req-c6763638-4d68-4524-b9e5-8d6911dc1744 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032316 Sep 05 12:34:43.342371 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 556/1100] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:46.365526 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a136bad7-7533-44b8-b1a3-baadd2dbd222 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:46.366072 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a136bad7-7533-44b8-b1a3-baadd2dbd222 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:46.368861 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-327023eb-1ce0-4b5f-986b-a374555ad63e req-09ee8dba-2515-4d08-a668-8946ef11d195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11d5a4f8-842e-423f-9974-d6d49a1b3bbb", "tag": "23399c5d-28fe-401d-861b-d0a48db49404"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:46.377364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a136bad7-7533-44b8-b1a3-baadd2dbd222 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:46.378146 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a136bad7-7533-44b8-b1a3-baadd2dbd222 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:46.378652 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a136bad7-7533-44b8-b1a3-baadd2dbd222 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:46.378790 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-327023eb-1ce0-4b5f-986b-a374555ad63e req-09ee8dba-2515-4d08-a668-8946ef11d195 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:46.379133 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-327023eb-1ce0-4b5f-986b-a374555ad63e req-09ee8dba-2515-4d08-a668-8946ef11d195 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:46.379540 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a136bad7-7533-44b8-b1a3-baadd2dbd222 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:46.379668 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-327023eb-1ce0-4b5f-986b-a374555ad63e req-09ee8dba-2515-4d08-a668-8946ef11d195 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:46.380095 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a136bad7-7533-44b8-b1a3-baadd2dbd222 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:46.380606 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a136bad7-7533-44b8-b1a3-baadd2dbd222 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:46.391300 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-327023eb-1ce0-4b5f-986b-a374555ad63e req-09ee8dba-2515-4d08-a668-8946ef11d195 service nova] Creating event network-changed:23399c5d-28fe-401d-861b-d0a48db49404 for instance 11d5a4f8-842e-423f-9974-d6d49a1b3bbb on hv-cinder-85518 Sep 05 12:34:46.396935 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-327023eb-1ce0-4b5f-986b-a374555ad63e req-09ee8dba-2515-4d08-a668-8946ef11d195 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032589 Sep 05 12:34:46.397661 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 557/1101] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:46.408637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a136bad7-7533-44b8-b1a3-baadd2dbd222 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Going to try to terminate instance {{(pid=120534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:34:46.496104 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a136bad7-7533-44b8-b1a3-baadd2dbd222 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 204 len: 0 microversion: 2.1 time: 0.134042 Sep 05 12:34:46.497388 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 545/1102] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:34:46 2022] DELETE /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:34:46.506759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c2a0b04b-8301-4a57-8d75-bec700af73fb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:46.507839 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c2a0b04b-8301-4a57-8d75-bec700af73fb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:46.515393 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c2a0b04b-8301-4a57-8d75-bec700af73fb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:46.515920 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c2a0b04b-8301-4a57-8d75-bec700af73fb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:46.516356 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c2a0b04b-8301-4a57-8d75-bec700af73fb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:46.517090 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c2a0b04b-8301-4a57-8d75-bec700af73fb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:46.517549 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c2a0b04b-8301-4a57-8d75-bec700af73fb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:46.517978 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c2a0b04b-8301-4a57-8d75-bec700af73fb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:46.651575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c2a0b04b-8301-4a57-8d75-bec700af73fb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:46.659553 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c2a0b04b-8301-4a57-8d75-bec700af73fb tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1575 microversion: 2.1 time: 0.157617 Sep 05 12:34:46.660161 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 558/1103] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:46 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:47.684202 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-75471f38-c1a6-48e7-bcbf-a031e66d46fd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:47.684815 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-75471f38-c1a6-48e7-bcbf-a031e66d46fd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:47.690929 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-75471f38-c1a6-48e7-bcbf-a031e66d46fd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.691411 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-75471f38-c1a6-48e7-bcbf-a031e66d46fd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.691886 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-75471f38-c1a6-48e7-bcbf-a031e66d46fd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.692572 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-75471f38-c1a6-48e7-bcbf-a031e66d46fd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.693016 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-75471f38-c1a6-48e7-bcbf-a031e66d46fd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.693439 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-75471f38-c1a6-48e7-bcbf-a031e66d46fd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.830285 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-75471f38-c1a6-48e7-bcbf-a031e66d46fd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:47.838763 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-75471f38-c1a6-48e7-bcbf-a031e66d46fd tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1575 microversion: 2.1 time: 0.158786 Sep 05 12:34:47.839342 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 546/1104] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:47 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:48.411221 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-d5ede2ad-33e8-4d54-91cf-d4db990faa51 req-8c1f95bb-a5f2-4437-8b36-2f14b3efca32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d5a4f8-842e-423f-9974-d6d49a1b3bbb", "name": "network-vif-deleted", "tag": "23399c5d-28fe-401d-861b-d0a48db49404"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:48.420983 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-d5ede2ad-33e8-4d54-91cf-d4db990faa51 req-8c1f95bb-a5f2-4437-8b36-2f14b3efca32 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:48.421449 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-d5ede2ad-33e8-4d54-91cf-d4db990faa51 req-8c1f95bb-a5f2-4437-8b36-2f14b3efca32 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:48.421870 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-d5ede2ad-33e8-4d54-91cf-d4db990faa51 req-8c1f95bb-a5f2-4437-8b36-2f14b3efca32 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:48.434704 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-d5ede2ad-33e8-4d54-91cf-d4db990faa51 req-8c1f95bb-a5f2-4437-8b36-2f14b3efca32 service nova] Creating event network-vif-deleted:23399c5d-28fe-401d-861b-d0a48db49404 for instance 11d5a4f8-842e-423f-9974-d6d49a1b3bbb on hv-cinder-85518 Sep 05 12:34:48.439286 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-d5ede2ad-33e8-4d54-91cf-d4db990faa51 req-8c1f95bb-a5f2-4437-8b36-2f14b3efca32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031673 Sep 05 12:34:48.439849 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 559/1105] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:48.862018 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7548b67c-caac-4dcf-9ad8-eab7f6512d3b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:48.862589 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7548b67c-caac-4dcf-9ad8-eab7f6512d3b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:48.869949 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7548b67c-caac-4dcf-9ad8-eab7f6512d3b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:48.870430 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7548b67c-caac-4dcf-9ad8-eab7f6512d3b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:48.870865 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7548b67c-caac-4dcf-9ad8-eab7f6512d3b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:48.871582 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7548b67c-caac-4dcf-9ad8-eab7f6512d3b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:48.872042 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7548b67c-caac-4dcf-9ad8-eab7f6512d3b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:48.872474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7548b67c-caac-4dcf-9ad8-eab7f6512d3b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:48.902735 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7548b67c-caac-4dcf-9ad8-eab7f6512d3b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:48.903208 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7548b67c-caac-4dcf-9ad8-eab7f6512d3b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:48.903669 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7548b67c-caac-4dcf-9ad8-eab7f6512d3b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:48.904117 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.objects.instance [None req-7548b67c-caac-4dcf-9ad8-eab7f6512d3b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lazy-loading 'fault' on Instance uuid 11d5a4f8-842e-423f-9974-d6d49a1b3bbb {{(pid=120534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:34:48.947902 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7548b67c-caac-4dcf-9ad8-eab7f6512d3b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd8a00f21344c7990ffe1a7ff2986ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5cb05cfc60481fa4144ee7b077ca4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:48.955577 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7548b67c-caac-4dcf-9ad8-eab7f6512d3b tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 200 len: 1229 microversion: 2.1 time: 0.097447 Sep 05 12:34:48.956138 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 547/1106] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:48 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:49.980789 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-37e4952a-86b2-48ee-a55e-9055787fed82 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:49.981629 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-37e4952a-86b2-48ee-a55e-9055787fed82 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 11d5a4f8-842e-423f-9974-d6d49a1b3bbb] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:49.987851 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-37e4952a-86b2-48ee-a55e-9055787fed82 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:49.988361 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-37e4952a-86b2-48ee-a55e-9055787fed82 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:49.988799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-37e4952a-86b2-48ee-a55e-9055787fed82 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:49.989481 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-37e4952a-86b2-48ee-a55e-9055787fed82 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:49.989937 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-37e4952a-86b2-48ee-a55e-9055787fed82 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:49.990364 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-37e4952a-86b2-48ee-a55e-9055787fed82 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:50.003897 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-37e4952a-86b2-48ee-a55e-9055787fed82 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] HTTP exception thrown: Instance 11d5a4f8-842e-423f-9974-d6d49a1b3bbb could not be found. Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-37e4952a-86b2-48ee-a55e-9055787fed82 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Request method failure captured: Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb HTTP/1.1 Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFerAZFsqYnyZnhqd68bLariOc-rXOkOi_rdB1cwlJU9qZpX2BFsWpEMzwXop-4f0E0zKv_r5THH5RksKaEe3kTPHDcyoDvRl8kwDAwJ5Y116h0AM82sJkpPukkrguMrZDjFnD-Ucz4skuXw8IeyKoCPkLcfYLThvXuFJUwxXrnph9nI Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 4d5cb05cfc60481fa4144ee7b077ca4f Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:34:50.005528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:34:50.007345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d5cb05cfc60481fa4144ee7b077ca4f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d5cb05cfc60481fa4144ee7b077ca4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d5cb05cfc60481fa4144ee7b077ca4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d5cb05cfc60481fa4144ee7b077ca4f"}]}] Sep 05 12:34:50.007345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:34:50.007345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 4d5cb05cfc60481fa4144ee7b077ca4f Sep 05 12:34:50.007345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:34:50.007345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-TestVolumeBootPattern-1174845777-project Sep 05 12:34:50.007345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:34:50.007345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:34:50.007345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: ebd8a00f21344c7990ffe1a7ff2986ef Sep 05 12:34:50.007345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-TestVolumeBootPattern-1174845777-project Sep 05 12:34:50.007345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:34:50.007345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance 11d5a4f8-842e-423f-9974-d6d49a1b3bbb could not be found. Sep 05 12:34:50.007345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '11d5a4f8-842e-423f-9974-d6d49a1b3bbb'} Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d5a4f8-842e-423f-9974-d6d49a1b3bbb could not be found. Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:34:50.008427 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d5a4f8-842e-423f-9974-d6d49a1b3bbb could not be found. Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d5a4f8-842e-423f-9974-d6d49a1b3bbb could not be found. Sep 05 12:34:50.010170 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.012460 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-37e4952a-86b2-48ee-a55e-9055787fed82 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Returning 404 to user: Instance 11d5a4f8-842e-423f-9974-d6d49a1b3bbb could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:34:50.012460 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-37e4952a-86b2-48ee-a55e-9055787fed82 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb" status: 404 len: 111 microversion: 2.1 time: 0.030869 Sep 05 12:34:50.012460 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 560/1107] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:49 2022] GET /compute/v2.1/servers/11d5a4f8-842e-423f-9974-d6d49a1b3bbb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:34:50.718339 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-00d9c47e-60df-422c-a9ce-136c63ea1c9f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:50.718874 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-00d9c47e-60df-422c-a9ce-136c63ea1c9f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:50.725247 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00d9c47e-60df-422c-a9ce-136c63ea1c9f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:50.725729 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00d9c47e-60df-422c-a9ce-136c63ea1c9f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:50.726165 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00d9c47e-60df-422c-a9ce-136c63ea1c9f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:50.726885 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00d9c47e-60df-422c-a9ce-136c63ea1c9f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:50.727339 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00d9c47e-60df-422c-a9ce-136c63ea1c9f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:50.727789 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00d9c47e-60df-422c-a9ce-136c63ea1c9f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:50.741560 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-00d9c47e-60df-422c-a9ce-136c63ea1c9f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] HTTP exception thrown: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-00d9c47e-60df-422c-a9ce-136c63ea1c9f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Request method failure captured: Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: DELETE /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f HTTP/1.1 Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFerAZFsqYnyZnhqd68bLariOc-rXOkOi_rdB1cwlJU9qZpX2BFsWpEMzwXop-4f0E0zKv_r5THH5RksKaEe3kTPHDcyoDvRl8kwDAwJ5Y116h0AM82sJkpPukkrguMrZDjFnD-Ucz4skuXw8IeyKoCPkLcfYLThvXuFJUwxXrnph9nI Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 4d5cb05cfc60481fa4144ee7b077ca4f Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:34:50.743229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:34:50.744975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d5cb05cfc60481fa4144ee7b077ca4f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d5cb05cfc60481fa4144ee7b077ca4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d5cb05cfc60481fa4144ee7b077ca4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d5cb05cfc60481fa4144ee7b077ca4f"}]}] Sep 05 12:34:50.744975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:34:50.744975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 4d5cb05cfc60481fa4144ee7b077ca4f Sep 05 12:34:50.744975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:34:50.744975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-TestVolumeBootPattern-1174845777-project Sep 05 12:34:50.744975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:34:50.744975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:34:50.744975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: ebd8a00f21344c7990ffe1a7ff2986ef Sep 05 12:34:50.744975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-TestVolumeBootPattern-1174845777-project Sep 05 12:34:50.744975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:34:50.744975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:34:50.744975 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '43404b9f-c23c-44b3-ba61-4420d1497d4f'} Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:34:50.745961 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:34:50.747548 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.749240 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-00d9c47e-60df-422c-a9ce-136c63ea1c9f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Returning 404 to user: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:34:50.749240 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-00d9c47e-60df-422c-a9ce-136c63ea1c9f tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 404 len: 111 microversion: 2.1 time: 0.030441 Sep 05 12:34:50.749240 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 548/1108] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:34:50 2022] DELETE /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:34:50.753301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b274987b-007d-40cb-a697-11c280f4f200 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:50.753916 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b274987b-007d-40cb-a697-11c280f4f200 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] [instance: 43404b9f-c23c-44b3-ba61-4420d1497d4f] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:50.759895 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b274987b-007d-40cb-a697-11c280f4f200 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:50.760864 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b274987b-007d-40cb-a697-11c280f4f200 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:50.761345 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b274987b-007d-40cb-a697-11c280f4f200 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:50.762091 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b274987b-007d-40cb-a697-11c280f4f200 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:50.762550 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b274987b-007d-40cb-a697-11c280f4f200 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:50.762976 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b274987b-007d-40cb-a697-11c280f4f200 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:50.777459 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-b274987b-007d-40cb-a697-11c280f4f200 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] HTTP exception thrown: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b274987b-007d-40cb-a697-11c280f4f200 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Request method failure captured: Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f HTTP/1.1 Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFerAZFsqYnyZnhqd68bLariOc-rXOkOi_rdB1cwlJU9qZpX2BFsWpEMzwXop-4f0E0zKv_r5THH5RksKaEe3kTPHDcyoDvRl8kwDAwJ5Y116h0AM82sJkpPukkrguMrZDjFnD-Ucz4skuXw8IeyKoCPkLcfYLThvXuFJUwxXrnph9nI Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 4d5cb05cfc60481fa4144ee7b077ca4f Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:34:50.778970 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:34:50.780835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d5cb05cfc60481fa4144ee7b077ca4f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d5cb05cfc60481fa4144ee7b077ca4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d5cb05cfc60481fa4144ee7b077ca4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d5cb05cfc60481fa4144ee7b077ca4f"}]}] Sep 05 12:34:50.780835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:34:50.780835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 4d5cb05cfc60481fa4144ee7b077ca4f Sep 05 12:34:50.780835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-TestVolumeBootPattern-1174845777 Sep 05 12:34:50.780835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-TestVolumeBootPattern-1174845777-project Sep 05 12:34:50.780835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:34:50.780835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:34:50.780835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: ebd8a00f21344c7990ffe1a7ff2986ef Sep 05 12:34:50.780835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-TestVolumeBootPattern-1174845777-project Sep 05 12:34:50.780835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:34:50.780835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:34:50.780835 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '43404b9f-c23c-44b3-ba61-4420d1497d4f'} Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:34:50.781887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. Sep 05 12:34:50.783469 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:34:50.784947 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b274987b-007d-40cb-a697-11c280f4f200 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Returning 404 to user: Instance 43404b9f-c23c-44b3-ba61-4420d1497d4f could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:34:50.784947 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b274987b-007d-40cb-a697-11c280f4f200 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f" status: 404 len: 111 microversion: 2.1 time: 0.031116 Sep 05 12:34:50.784947 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 561/1109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:50 2022] GET /compute/v2.1/servers/43404b9f-c23c-44b3-ba61-4420d1497d4f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:34:52.067224 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-462b722d-d178-4983-ba02-492f03755178 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] Calling method '.version_select at 0x7fba4b957d30>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:52.087468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-462b722d-d178-4983-ba02-492f03755178 tempest-TestVolumeBootPattern-1174845777 tempest-TestVolumeBootPattern-1174845777-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-246234878" status: 202 len: 0 microversion: 2.1 time: 0.024015 Sep 05 12:34:52.088860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 549/1110] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Sep 5 12:34:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-246234878 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:35:56.480507 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=11 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:56.481270 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=38 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:56.700831 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b981b7f5-610d-4d2d-bba1-c130d439bd42 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:56.701347 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b981b7f5-610d-4d2d-bba1-c130d439bd42 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:56.707221 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b981b7f5-610d-4d2d-bba1-c130d439bd42 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:56.707736 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b981b7f5-610d-4d2d-bba1-c130d439bd42 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:56.708169 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b981b7f5-610d-4d2d-bba1-c130d439bd42 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:56.708846 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b981b7f5-610d-4d2d-bba1-c130d439bd42 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:56.709301 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b981b7f5-610d-4d2d-bba1-c130d439bd42 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:56.709721 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b981b7f5-610d-4d2d-bba1-c130d439bd42 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:56.732775 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b981b7f5-610d-4d2d-bba1-c130d439bd42 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/ips" status: 200 len: 151 microversion: 2.1 time: 0.254094 Sep 05 12:35:56.733348 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 562/1111] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Sep 5 12:35:56 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/ips => generated 151 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:58.062786 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:58.063570 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:58.064795 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:35:58.064940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Mon Sep 5 12:35:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/os-volume_attachments (ip 10.222.0.16) !!! Sep 05 12:35:58.071551 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-35064e7e-bcef-4521-96a1-9117f3f7c31b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3169b19-9689-4c8c-a3d5-9143d2db0f2b"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:58.074560 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-35064e7e-bcef-4521-96a1-9117f3f7c31b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:58.084287 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-35064e7e-bcef-4521-96a1-9117f3f7c31b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:58.084728 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-35064e7e-bcef-4521-96a1-9117f3f7c31b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:58.085162 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-35064e7e-bcef-4521-96a1-9117f3f7c31b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:58.085851 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-35064e7e-bcef-4521-96a1-9117f3f7c31b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:58.086303 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-35064e7e-bcef-4521-96a1-9117f3f7c31b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:58.086725 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-35064e7e-bcef-4521-96a1-9117f3f7c31b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:58.344557 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-35064e7e-bcef-4521-96a1-9117f3f7c31b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "POST /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283448 Sep 05 12:35:58.345186 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 550/1112] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Sep 5 12:35:58 2022] POST /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:05.880307 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ed47d67c-4c45-4638-981b-f1d3f24a672d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3169b19-9689-4c8c-a3d5-9143d2db0f2b"}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:36:05.882682 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ed47d67c-4c45-4638-981b-f1d3f24a672d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:05.889543 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed47d67c-4c45-4638-981b-f1d3f24a672d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:05.890017 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed47d67c-4c45-4638-981b-f1d3f24a672d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:05.890444 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed47d67c-4c45-4638-981b-f1d3f24a672d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:05.891121 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed47d67c-4c45-4638-981b-f1d3f24a672d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:05.891592 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed47d67c-4c45-4638-981b-f1d3f24a672d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:05.892011 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ed47d67c-4c45-4638-981b-f1d3f24a672d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:05.970485 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-ed47d67c-4c45-4638-981b-f1d3f24a672d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] HTTP exception thrown: Invalid volume: volume f3169b19-9689-4c8c-a3d5-9143d2db0f2b is already attached to instances: 27958846-c92c-487b-a866-83591259f73b Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ed47d67c-4c45-4638-981b-f1d3f24a672d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Request method failure captured: Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: POST /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/os-volume_attachments HTTP/1.1 Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 74 Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFevbiPOhfWakBg3IVNlM2z9awKnqcWXEXE6jd60IlWvr06bkTobODUMmVlgk4EZARnR8xj6eOknNEMDHft90bVE1X13zu3SJw17J3mnuQG4esDJYolpUwF3G-wm0_7mTBIPn9061RQE0yvRD_YUhaVGIPYeeRpfG_-GH9f1mUHiqs3E Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:36:05.972118 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:36:05.973934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d3972b5b8b24e999998d2616531f9e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}] Sep 05 12:36:05.973934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:36:05.973934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:36:05.973934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:36:05.973934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:36:05.973934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:36:05.973934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:36:05.973934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: ee580cfc10dd4536b0709e65e3d23d4d Sep 05 12:36:05.973934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:36:05.973934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Sep 05 12:36:05.973934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {"volumeAttachment": {"volumeId": "f3169b19-9689-4c8c-a3d5-9143d2db0f2b"}} Sep 05 12:36:05.973934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Invalid volume: volume f3169b19-9689-4c8c-a3d5-9143d2db0f2b is already attached to instances: 27958846-c92c-487b-a866-83591259f73b Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'server_id': '27958846-c92c-487b-a866-83591259f73b', 'body': {'volumeAttachment': {'volumeId': 'f3169b19-9689-4c8c-a3d5-9143d2db0f2b'}}} Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f3169b19-9689-4c8c-a3d5-9143d2db0f2b is already attached to instances: 27958846-c92c-487b-a866-83591259f73b Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:36:05.975166 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f3169b19-9689-4c8c-a3d5-9143d2db0f2b is already attached to instances: 27958846-c92c-487b-a866-83591259f73b Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:05.976799 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:05.978611 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:05.978611 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:05.978611 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:05.978611 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f3169b19-9689-4c8c-a3d5-9143d2db0f2b is already attached to instances: 27958846-c92c-487b-a866-83591259f73b Sep 05 12:36:05.978611 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:36:05.978611 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ed47d67c-4c45-4638-981b-f1d3f24a672d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Returning 400 to user: Invalid volume: volume f3169b19-9689-4c8c-a3d5-9143d2db0f2b is already attached to instances: 27958846-c92c-487b-a866-83591259f73b {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:05.978611 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ed47d67c-4c45-4638-981b-f1d3f24a672d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "POST /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097374 Sep 05 12:36:05.978611 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 563/1113] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Sep 5 12:36:05 2022] POST /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:36:06.040702 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-047efbeb-95a5-46b2-8325-39ec3b97fe7f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:06.041291 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-047efbeb-95a5-46b2-8325-39ec3b97fe7f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:06.047542 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-047efbeb-95a5-46b2-8325-39ec3b97fe7f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:06.048040 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-047efbeb-95a5-46b2-8325-39ec3b97fe7f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:06.048480 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-047efbeb-95a5-46b2-8325-39ec3b97fe7f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:06.049186 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-047efbeb-95a5-46b2-8325-39ec3b97fe7f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:06.049643 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-047efbeb-95a5-46b2-8325-39ec3b97fe7f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:06.050091 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-047efbeb-95a5-46b2-8325-39ec3b97fe7f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:06.128656 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.objects.instance [None req-047efbeb-95a5-46b2-8325-39ec3b97fe7f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lazy-loading 'services' on Instance uuid 27958846-c92c-487b-a866-83591259f73b {{(pid=120534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:36:06.198847 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-047efbeb-95a5-46b2-8325-39ec3b97fe7f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/os-volume_attachments/f3169b19-9689-4c8c-a3d5-9143d2db0f2b" status: 202 len: 0 microversion: 2.1 time: 0.162158 Sep 05 12:36:06.199434 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 551/1114] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Sep 5 12:36:06 2022] DELETE /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/os-volume_attachments/f3169b19-9689-4c8c-a3d5-9143d2db0f2b => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:36:06.207762 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-bbdbc957-a442-4bc4-9816-b4ff5edd4f68 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:06.210021 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-bbdbc957-a442-4bc4-9816-b4ff5edd4f68 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:06.216047 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bbdbc957-a442-4bc4-9816-b4ff5edd4f68 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:06.216531 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bbdbc957-a442-4bc4-9816-b4ff5edd4f68 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:06.216973 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bbdbc957-a442-4bc4-9816-b4ff5edd4f68 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:06.217759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bbdbc957-a442-4bc4-9816-b4ff5edd4f68 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:06.218112 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bbdbc957-a442-4bc4-9816-b4ff5edd4f68 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:06.218535 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-bbdbc957-a442-4bc4-9816-b4ff5edd4f68 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:06.249838 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-bbdbc957-a442-4bc4-9816-b4ff5edd4f68 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045966 Sep 05 12:36:06.250407 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 564/1115] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:36:06 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:07.263951 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f220a2f7-e035-4001-ad08-4f0dc15bbbf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:07.266194 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f220a2f7-e035-4001-ad08-4f0dc15bbbf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:07.272623 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f220a2f7-e035-4001-ad08-4f0dc15bbbf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:07.273106 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f220a2f7-e035-4001-ad08-4f0dc15bbbf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:07.273545 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f220a2f7-e035-4001-ad08-4f0dc15bbbf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:07.274234 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f220a2f7-e035-4001-ad08-4f0dc15bbbf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:07.274687 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f220a2f7-e035-4001-ad08-4f0dc15bbbf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:07.275113 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f220a2f7-e035-4001-ad08-4f0dc15bbbf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:07.303768 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f220a2f7-e035-4001-ad08-4f0dc15bbbf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045222 Sep 05 12:36:07.304318 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 552/1116] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:36:07 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:36:07.365883 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c877cf7c-c2b3-41a2-8cc3-abf20d40d7b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:07.366387 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c877cf7c-c2b3-41a2-8cc3-abf20d40d7b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:07.373046 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c877cf7c-c2b3-41a2-8cc3-abf20d40d7b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:07.374006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c877cf7c-c2b3-41a2-8cc3-abf20d40d7b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:07.374006 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c877cf7c-c2b3-41a2-8cc3-abf20d40d7b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:07.374632 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c877cf7c-c2b3-41a2-8cc3-abf20d40d7b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:07.375087 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c877cf7c-c2b3-41a2-8cc3-abf20d40d7b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:07.375517 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c877cf7c-c2b3-41a2-8cc3-abf20d40d7b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:07.400774 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c877cf7c-c2b3-41a2-8cc3-abf20d40d7b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Going to try to terminate instance {{(pid=120535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:36:07.481293 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c877cf7c-c2b3-41a2-8cc3-abf20d40d7b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 204 len: 0 microversion: 2.1 time: 0.119007 Sep 05 12:36:07.485324 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 565/1117] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:36:07 2022] DELETE /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:36:07.490417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f4939eac-ec35-4ec0-a11b-c5fc1592ce52 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:07.491027 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f4939eac-ec35-4ec0-a11b-c5fc1592ce52 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:07.497042 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f4939eac-ec35-4ec0-a11b-c5fc1592ce52 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:07.497524 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f4939eac-ec35-4ec0-a11b-c5fc1592ce52 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:07.497968 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f4939eac-ec35-4ec0-a11b-c5fc1592ce52 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:07.498651 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f4939eac-ec35-4ec0-a11b-c5fc1592ce52 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:07.499105 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f4939eac-ec35-4ec0-a11b-c5fc1592ce52 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:07.499552 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f4939eac-ec35-4ec0-a11b-c5fc1592ce52 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:07.626559 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-f4939eac-ec35-4ec0-a11b-c5fc1592ce52 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:07.634357 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f4939eac-ec35-4ec0-a11b-c5fc1592ce52 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1681 microversion: 2.1 time: 0.147932 Sep 05 12:36:07.634956 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 553/1118] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:07 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:08.659067 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-deb09341-7ddb-42d7-89f5-3563e33fcfc6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:08.659733 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-deb09341-7ddb-42d7-89f5-3563e33fcfc6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:08.666097 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-deb09341-7ddb-42d7-89f5-3563e33fcfc6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:08.666610 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-deb09341-7ddb-42d7-89f5-3563e33fcfc6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:08.667676 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-deb09341-7ddb-42d7-89f5-3563e33fcfc6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:08.668367 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-deb09341-7ddb-42d7-89f5-3563e33fcfc6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:08.668820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-deb09341-7ddb-42d7-89f5-3563e33fcfc6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:08.669245 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-deb09341-7ddb-42d7-89f5-3563e33fcfc6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:08.797029 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-deb09341-7ddb-42d7-89f5-3563e33fcfc6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:08.804765 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-deb09341-7ddb-42d7-89f5-3563e33fcfc6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1681 microversion: 2.1 time: 0.150049 Sep 05 12:36:08.805327 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 566/1119] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:08 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:09.827909 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-00161fca-1f27-489f-8e6b-5d790cc0b909 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:09.828558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-00161fca-1f27-489f-8e6b-5d790cc0b909 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:09.835074 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00161fca-1f27-489f-8e6b-5d790cc0b909 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:09.835585 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00161fca-1f27-489f-8e6b-5d790cc0b909 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:09.836032 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00161fca-1f27-489f-8e6b-5d790cc0b909 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:09.836731 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00161fca-1f27-489f-8e6b-5d790cc0b909 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:09.837191 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00161fca-1f27-489f-8e6b-5d790cc0b909 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:09.837624 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-00161fca-1f27-489f-8e6b-5d790cc0b909 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:09.969200 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-00161fca-1f27-489f-8e6b-5d790cc0b909 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:09.977073 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-00161fca-1f27-489f-8e6b-5d790cc0b909 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1681 microversion: 2.1 time: 0.153157 Sep 05 12:36:09.977780 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 554/1120] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:09 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:10.544903 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-01ec6b46-5929-4ccf-aa85-3dea6c2f27b6 req-19723c7e-11d1-48cc-b9f2-bf7158bdf0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27958846-c92c-487b-a866-83591259f73b", "name": "network-vif-deleted", "tag": "919fcbc7-3803-4a18-b258-517be0763bec"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:36:10.559075 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-01ec6b46-5929-4ccf-aa85-3dea6c2f27b6 req-19723c7e-11d1-48cc-b9f2-bf7158bdf0a9 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:10.559890 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-01ec6b46-5929-4ccf-aa85-3dea6c2f27b6 req-19723c7e-11d1-48cc-b9f2-bf7158bdf0a9 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:10.560524 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-01ec6b46-5929-4ccf-aa85-3dea6c2f27b6 req-19723c7e-11d1-48cc-b9f2-bf7158bdf0a9 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:10.578752 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-01ec6b46-5929-4ccf-aa85-3dea6c2f27b6 req-19723c7e-11d1-48cc-b9f2-bf7158bdf0a9 service nova] Creating event network-vif-deleted:919fcbc7-3803-4a18-b258-517be0763bec for instance 27958846-c92c-487b-a866-83591259f73b on hv-cinder-85518 Sep 05 12:36:10.584081 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-01ec6b46-5929-4ccf-aa85-3dea6c2f27b6 req-19723c7e-11d1-48cc-b9f2-bf7158bdf0a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107550 Sep 05 12:36:10.585196 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 567/1121] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:11.001602 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-666a294d-2875-4abe-bcaf-d818fa64d420 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:11.002383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-666a294d-2875-4abe-bcaf-d818fa64d420 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:11.008927 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-666a294d-2875-4abe-bcaf-d818fa64d420 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:11.009537 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-666a294d-2875-4abe-bcaf-d818fa64d420 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:11.010082 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-666a294d-2875-4abe-bcaf-d818fa64d420 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:11.011068 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-666a294d-2875-4abe-bcaf-d818fa64d420 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:11.011818 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-666a294d-2875-4abe-bcaf-d818fa64d420 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:11.012438 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-666a294d-2875-4abe-bcaf-d818fa64d420 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:11.047335 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-666a294d-2875-4abe-bcaf-d818fa64d420 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:11.048140 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-666a294d-2875-4abe-bcaf-d818fa64d420 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:11.048587 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-666a294d-2875-4abe-bcaf-d818fa64d420 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:11.049095 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.objects.instance [None req-666a294d-2875-4abe-bcaf-d818fa64d420 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lazy-loading 'fault' on Instance uuid 27958846-c92c-487b-a866-83591259f73b {{(pid=120534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:36:11.100447 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-666a294d-2875-4abe-bcaf-d818fa64d420 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:11.108885 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-666a294d-2875-4abe-bcaf-d818fa64d420 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 200 len: 1330 microversion: 2.1 time: 0.111163 Sep 05 12:36:11.109458 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 555/1122] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:10 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:12.134202 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a3e199f8-4526-4ef0-8a48-a6ccea3afda1 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:12.134898 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a3e199f8-4526-4ef0-8a48-a6ccea3afda1 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:12.141585 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a3e199f8-4526-4ef0-8a48-a6ccea3afda1 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:12.142055 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a3e199f8-4526-4ef0-8a48-a6ccea3afda1 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:12.142481 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a3e199f8-4526-4ef0-8a48-a6ccea3afda1 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:12.143412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a3e199f8-4526-4ef0-8a48-a6ccea3afda1 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:12.143879 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a3e199f8-4526-4ef0-8a48-a6ccea3afda1 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:12.144296 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a3e199f8-4526-4ef0-8a48-a6ccea3afda1 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:12.157152 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-a3e199f8-4526-4ef0-8a48-a6ccea3afda1 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] HTTP exception thrown: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a3e199f8-4526-4ef0-8a48-a6ccea3afda1 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Request method failure captured: Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b HTTP/1.1 Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFevbiPOhfWakBg3IVNlM2z9awKnqcWXEXE6jd60IlWvr06bkTobODUMmVlgk4EZARnR8xj6eOknNEMDHft90bVE1X13zu3SJw17J3mnuQG4esDJYolpUwF3G-wm0_7mTBIPn9061RQE0yvRD_YUhaVGIPYeeRpfG_-GH9f1mUHiqs3E Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:36:12.158722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:36:12.160480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d3972b5b8b24e999998d2616531f9e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}] Sep 05 12:36:12.160480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:36:12.160480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:36:12.160480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:36:12.160480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:36:12.160480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:36:12.160480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:36:12.160480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: ee580cfc10dd4536b0709e65e3d23d4d Sep 05 12:36:12.160480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:36:12.160480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:36:12.160480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:36:12.160480 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '27958846-c92c-487b-a866-83591259f73b'} Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:12.161652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:36:12.163268 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:36:12.164915 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a3e199f8-4526-4ef0-8a48-a6ccea3afda1 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Returning 404 to user: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:12.164915 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a3e199f8-4526-4ef0-8a48-a6ccea3afda1 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 404 len: 111 microversion: 2.1 time: 0.030534 Sep 05 12:36:12.164915 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 568/1123] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:12 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:36:12.168736 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-593cc3be-527c-40cb-be41-daf1c03e4e24 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '.version_select at 0x7fba4bbb31f0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:12.187648 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-593cc3be-527c-40cb-be41-daf1c03e4e24 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-757862119" status: 202 len: 0 microversion: 2.1 time: 0.022707 Sep 05 12:36:12.188215 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 556/1124] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Sep 5 12:36:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-757862119 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 12:36:12.792900 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-138cc2fd-832c-4be5-bf29-3459bd3f0cb8 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Action: 'create', calling method: .version_select at 0x7fba4b9410d0>, body: {"keypair": {"name": "tempest-keypair-1369862171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOXdYZfJ8C4vhs8MFOIGi0KSmRyv5iZ+LSsbGGBWeE/ZlOsyCuwcWs7JcODB2gRHsUEc45LHM1+BIB2Dj2+jHqYDtOFkFFkecZ0gh4/ag1FnafuLo0cd02W88+H1/HHSg=="}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:36:12.808187 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-138cc2fd-832c-4be5-bf29-3459bd3f0cb8 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'key_pairs'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:36:12.812033 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-138cc2fd-832c-4be5-bf29-3459bd3f0cb8 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for user ee580cfc10dd4536b0709e65e3d23d4d and project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'key_pairs'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:36:12.833582 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-138cc2fd-832c-4be5-bf29-3459bd3f0cb8 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045058 Sep 05 12:36:12.834147 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 569/1125] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Sep 5 12:36:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:14.028952 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1584977886", "imageRef": "ab8c39d0-c06f-4d96-aa26-89a93303bd82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49732eeb-e082-4048-831f-1af5d3375981"}], "security_groups": [{"name": "tempest-securitygroup--559621687"}], "key_name": "tempest-keypair-1369862171", "user_data": "}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:36:14.132586 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.network.neutron [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] validate_networks() for [('49732eeb-e082-4048-831f-1af5d3375981', None, None, None, None, None)] {{(pid=120534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:36:14.499757 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Flavor limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:36:14.500182 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Image limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:36:14.500680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Flavor pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:36:14.501089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Image pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:36:14.501498 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:36:14.510933 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:14.511407 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:14.511862 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:14.512592 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:14.513039 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:14.513459 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:14.531466 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:36:14.535445 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Getting quotas for user ee580cfc10dd4536b0709e65e3d23d4d and project 0d3972b5b8b24e999998d2616531f9e7. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:36:14.547131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Going to run 1 instances... {{(pid=120534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:36:14.549472 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab8c39d0-c06f-4d96-aa26-89a93303bd82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:36:14.599508 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-41f9fdb7-9f37-4314-a2a3-56b53a3fa8f7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.575400 Sep 05 12:36:14.600185 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 557/1126] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:36:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 05 12:36:14.611804 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1495db50-0230-42b3-b23e-34f9e3b6925b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:14.612421 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-1495db50-0230-42b3-b23e-34f9e3b6925b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:14.668714 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1495db50-0230-42b3-b23e-34f9e3b6925b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:14.676365 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1495db50-0230-42b3-b23e-34f9e3b6925b tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1242 microversion: 2.1 time: 0.068536 Sep 05 12:36:14.676997 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 570/1127] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:14 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:15.699532 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-33f26832-b1e2-4a42-913f-76650898d9a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:15.700140 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-33f26832-b1e2-4a42-913f-76650898d9a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:15.706884 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-33f26832-b1e2-4a42-913f-76650898d9a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:15.707368 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-33f26832-b1e2-4a42-913f-76650898d9a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:15.707833 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-33f26832-b1e2-4a42-913f-76650898d9a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:15.708523 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-33f26832-b1e2-4a42-913f-76650898d9a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:15.708973 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-33f26832-b1e2-4a42-913f-76650898d9a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:15.709393 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-33f26832-b1e2-4a42-913f-76650898d9a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:15.772301 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-33f26832-b1e2-4a42-913f-76650898d9a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:15.780825 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-33f26832-b1e2-4a42-913f-76650898d9a5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1302 microversion: 2.1 time: 0.085717 Sep 05 12:36:15.781397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 558/1128] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:15 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:16.804193 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9ff69ec3-fa7b-4935-bbe5-6d046fbc9865 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:16.804797 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-9ff69ec3-fa7b-4935-bbe5-6d046fbc9865 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:16.811181 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9ff69ec3-fa7b-4935-bbe5-6d046fbc9865 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:16.811769 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9ff69ec3-fa7b-4935-bbe5-6d046fbc9865 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:16.812207 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9ff69ec3-fa7b-4935-bbe5-6d046fbc9865 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:16.812901 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9ff69ec3-fa7b-4935-bbe5-6d046fbc9865 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:16.813418 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9ff69ec3-fa7b-4935-bbe5-6d046fbc9865 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:16.813850 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9ff69ec3-fa7b-4935-bbe5-6d046fbc9865 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:17.004285 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-9ff69ec3-fa7b-4935-bbe5-6d046fbc9865 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:17.012816 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9ff69ec3-fa7b-4935-bbe5-6d046fbc9865 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1367 microversion: 2.1 time: 0.212609 Sep 05 12:36:17.013375 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 571/1129] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:16 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:17.283677 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-35096cea-5862-41d9-b4ef-0f7054ba8f60 req-88f123b2-3f06-4b9b-98dd-6b7cc5b4f4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874bbcea-ca61-4335-aca0-c14a1c9a5314", "tag": "304a7c2a-fa78-4fe8-bd48-e89f01cc8d8d"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:36:17.296002 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-35096cea-5862-41d9-b4ef-0f7054ba8f60 req-88f123b2-3f06-4b9b-98dd-6b7cc5b4f4b2 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:17.296490 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-35096cea-5862-41d9-b4ef-0f7054ba8f60 req-88f123b2-3f06-4b9b-98dd-6b7cc5b4f4b2 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:17.296918 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-35096cea-5862-41d9-b4ef-0f7054ba8f60 req-88f123b2-3f06-4b9b-98dd-6b7cc5b4f4b2 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:17.309670 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-35096cea-5862-41d9-b4ef-0f7054ba8f60 req-88f123b2-3f06-4b9b-98dd-6b7cc5b4f4b2 service nova] Creating event network-changed:304a7c2a-fa78-4fe8-bd48-e89f01cc8d8d for instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 on hv-cinder-85518 Sep 05 12:36:17.315794 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-35096cea-5862-41d9-b4ef-0f7054ba8f60 req-88f123b2-3f06-4b9b-98dd-6b7cc5b4f4b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036831 Sep 05 12:36:17.316384 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 559/1130] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:18.036757 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-485cb08c-cb92-492d-afa5-809c165ea920 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:18.037361 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-485cb08c-cb92-492d-afa5-809c165ea920 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:18.044353 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-485cb08c-cb92-492d-afa5-809c165ea920 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:18.044837 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-485cb08c-cb92-492d-afa5-809c165ea920 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:18.045270 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-485cb08c-cb92-492d-afa5-809c165ea920 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:18.045962 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-485cb08c-cb92-492d-afa5-809c165ea920 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:18.046412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-485cb08c-cb92-492d-afa5-809c165ea920 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:18.046838 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-485cb08c-cb92-492d-afa5-809c165ea920 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:18.181962 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-485cb08c-cb92-492d-afa5-809c165ea920 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:18.189580 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-485cb08c-cb92-492d-afa5-809c165ea920 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1367 microversion: 2.1 time: 0.156721 Sep 05 12:36:18.190139 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 572/1131] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:18 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:19.212612 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-fdc0b760-3d07-4627-a406-24f2b95bcb8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:19.213305 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-fdc0b760-3d07-4627-a406-24f2b95bcb8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:19.220137 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fdc0b760-3d07-4627-a406-24f2b95bcb8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:19.220617 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fdc0b760-3d07-4627-a406-24f2b95bcb8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:19.221048 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fdc0b760-3d07-4627-a406-24f2b95bcb8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:19.221731 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fdc0b760-3d07-4627-a406-24f2b95bcb8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:19.222181 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fdc0b760-3d07-4627-a406-24f2b95bcb8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:19.222634 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-fdc0b760-3d07-4627-a406-24f2b95bcb8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:19.346823 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-fdc0b760-3d07-4627-a406-24f2b95bcb8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:19.354900 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-fdc0b760-3d07-4627-a406-24f2b95bcb8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1367 microversion: 2.1 time: 0.146088 Sep 05 12:36:19.355468 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 560/1132] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:19 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:20.377398 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-9b842808-ab8f-47b6-aa72-afdb8bdd2851 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:20.378018 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-9b842808-ab8f-47b6-aa72-afdb8bdd2851 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:20.384448 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9b842808-ab8f-47b6-aa72-afdb8bdd2851 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:20.384934 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9b842808-ab8f-47b6-aa72-afdb8bdd2851 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:20.385999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9b842808-ab8f-47b6-aa72-afdb8bdd2851 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:20.386692 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9b842808-ab8f-47b6-aa72-afdb8bdd2851 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:20.387143 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9b842808-ab8f-47b6-aa72-afdb8bdd2851 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:20.387588 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-9b842808-ab8f-47b6-aa72-afdb8bdd2851 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:20.512780 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-9b842808-ab8f-47b6-aa72-afdb8bdd2851 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:20.520594 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-9b842808-ab8f-47b6-aa72-afdb8bdd2851 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1367 microversion: 2.1 time: 0.147098 Sep 05 12:36:20.521152 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 573/1133] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:20 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:21.542206 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-71da22e8-974a-47e9-aa3c-54814c75fd30 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:21.542827 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-71da22e8-974a-47e9-aa3c-54814c75fd30 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:21.549284 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-71da22e8-974a-47e9-aa3c-54814c75fd30 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:21.549770 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-71da22e8-974a-47e9-aa3c-54814c75fd30 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:21.550212 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-71da22e8-974a-47e9-aa3c-54814c75fd30 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:21.550901 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-71da22e8-974a-47e9-aa3c-54814c75fd30 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:21.551361 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-71da22e8-974a-47e9-aa3c-54814c75fd30 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:21.551823 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-71da22e8-974a-47e9-aa3c-54814c75fd30 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:21.677814 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-71da22e8-974a-47e9-aa3c-54814c75fd30 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:21.685440 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-71da22e8-974a-47e9-aa3c-54814c75fd30 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1367 microversion: 2.1 time: 0.147168 Sep 05 12:36:21.685994 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 561/1134] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:21 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:22.708141 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-22fadcc6-7899-4d79-bd89-2e5ac28c45aa tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:22.708861 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-22fadcc6-7899-4d79-bd89-2e5ac28c45aa tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:22.715307 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-22fadcc6-7899-4d79-bd89-2e5ac28c45aa tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:22.715902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-22fadcc6-7899-4d79-bd89-2e5ac28c45aa tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:22.716335 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-22fadcc6-7899-4d79-bd89-2e5ac28c45aa tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:22.717023 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-22fadcc6-7899-4d79-bd89-2e5ac28c45aa tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:22.717482 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-22fadcc6-7899-4d79-bd89-2e5ac28c45aa tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:22.717902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-22fadcc6-7899-4d79-bd89-2e5ac28c45aa tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:22.846285 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-22fadcc6-7899-4d79-bd89-2e5ac28c45aa tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:22.853935 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-22fadcc6-7899-4d79-bd89-2e5ac28c45aa tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1367 microversion: 2.1 time: 0.149736 Sep 05 12:36:22.854493 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 574/1135] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:22 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:23.876664 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-91bd140c-6676-4a24-bad3-30573291db07 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:23.877268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-91bd140c-6676-4a24-bad3-30573291db07 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:23.883680 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-91bd140c-6676-4a24-bad3-30573291db07 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:23.884154 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-91bd140c-6676-4a24-bad3-30573291db07 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:23.884582 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-91bd140c-6676-4a24-bad3-30573291db07 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:23.885261 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-91bd140c-6676-4a24-bad3-30573291db07 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:23.886211 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-91bd140c-6676-4a24-bad3-30573291db07 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:23.886632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-91bd140c-6676-4a24-bad3-30573291db07 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:24.015056 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-91bd140c-6676-4a24-bad3-30573291db07 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:24.023017 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-91bd140c-6676-4a24-bad3-30573291db07 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1367 microversion: 2.1 time: 0.150208 Sep 05 12:36:24.023624 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 562/1136] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:23 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:24.693287 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=6 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:24.752097 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-5402da88-73fe-41ba-9870-1540474883cd req-39433cf3-3609-4034-b071-7d8008f4e1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874bbcea-ca61-4335-aca0-c14a1c9a5314", "name": "network-vif-plugged", "status": "completed", "tag": "304a7c2a-fa78-4fe8-bd48-e89f01cc8d8d"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:36:24.762176 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-5402da88-73fe-41ba-9870-1540474883cd req-39433cf3-3609-4034-b071-7d8008f4e1e3 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:24.762649 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-5402da88-73fe-41ba-9870-1540474883cd req-39433cf3-3609-4034-b071-7d8008f4e1e3 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:24.763066 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-5402da88-73fe-41ba-9870-1540474883cd req-39433cf3-3609-4034-b071-7d8008f4e1e3 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:24.773777 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-5402da88-73fe-41ba-9870-1540474883cd req-39433cf3-3609-4034-b071-7d8008f4e1e3 service nova] Creating event network-vif-plugged:304a7c2a-fa78-4fe8-bd48-e89f01cc8d8d for instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 on hv-cinder-85518 Sep 05 12:36:24.778865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-5402da88-73fe-41ba-9870-1540474883cd req-39433cf3-3609-4034-b071-7d8008f4e1e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090610 Sep 05 12:36:24.779491 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 575/1137] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:25.046840 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a86db27b-7490-4fe4-a8c3-d22cb67cecb8 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:25.047450 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a86db27b-7490-4fe4-a8c3-d22cb67cecb8 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:25.049413 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:25.050065 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=6 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:25.056092 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a86db27b-7490-4fe4-a8c3-d22cb67cecb8 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:25.056568 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a86db27b-7490-4fe4-a8c3-d22cb67cecb8 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:25.056998 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a86db27b-7490-4fe4-a8c3-d22cb67cecb8 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:25.057722 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a86db27b-7490-4fe4-a8c3-d22cb67cecb8 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:25.058209 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a86db27b-7490-4fe4-a8c3-d22cb67cecb8 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:25.058631 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a86db27b-7490-4fe4-a8c3-d22cb67cecb8 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:25.186419 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a86db27b-7490-4fe4-a8c3-d22cb67cecb8 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:25.193868 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a86db27b-7490-4fe4-a8c3-d22cb67cecb8 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1367 microversion: 2.1 time: 0.150874 Sep 05 12:36:25.194434 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 563/1138] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:25 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:26.217623 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8492c05e-9a40-4ff4-bacb-e6f34d120775 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:26.218273 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8492c05e-9a40-4ff4-bacb-e6f34d120775 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:26.224848 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8492c05e-9a40-4ff4-bacb-e6f34d120775 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:26.225325 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8492c05e-9a40-4ff4-bacb-e6f34d120775 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:26.225757 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8492c05e-9a40-4ff4-bacb-e6f34d120775 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:26.226439 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8492c05e-9a40-4ff4-bacb-e6f34d120775 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:26.226889 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8492c05e-9a40-4ff4-bacb-e6f34d120775 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:26.227311 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8492c05e-9a40-4ff4-bacb-e6f34d120775 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:26.363878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8492c05e-9a40-4ff4-bacb-e6f34d120775 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:26.371466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8492c05e-9a40-4ff4-bacb-e6f34d120775 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1367 microversion: 2.1 time: 0.158080 Sep 05 12:36:26.372065 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 576/1139] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:26 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:27.394433 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a3b504b8-be57-4a9e-85b0-71281b055af3 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:27.395044 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a3b504b8-be57-4a9e-85b0-71281b055af3 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:27.401937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a3b504b8-be57-4a9e-85b0-71281b055af3 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:27.402406 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a3b504b8-be57-4a9e-85b0-71281b055af3 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:27.402833 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a3b504b8-be57-4a9e-85b0-71281b055af3 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:27.403510 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a3b504b8-be57-4a9e-85b0-71281b055af3 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:27.403981 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a3b504b8-be57-4a9e-85b0-71281b055af3 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:27.404403 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a3b504b8-be57-4a9e-85b0-71281b055af3 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:27.530073 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-a3b504b8-be57-4a9e-85b0-71281b055af3 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:27.537801 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a3b504b8-be57-4a9e-85b0-71281b055af3 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1558 microversion: 2.1 time: 0.147490 Sep 05 12:36:27.538368 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 564/1140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:27 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:27.559604 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-02745ab7-2be4-4a6d-b7a9-9e3853af7c24 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:27.560124 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-02745ab7-2be4-4a6d-b7a9-9e3853af7c24 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:27.562522 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:27.568630 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02745ab7-2be4-4a6d-b7a9-9e3853af7c24 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:27.569113 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02745ab7-2be4-4a6d-b7a9-9e3853af7c24 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:27.569551 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02745ab7-2be4-4a6d-b7a9-9e3853af7c24 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:27.570267 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02745ab7-2be4-4a6d-b7a9-9e3853af7c24 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:27.570721 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02745ab7-2be4-4a6d-b7a9-9e3853af7c24 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:27.571146 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-02745ab7-2be4-4a6d-b7a9-9e3853af7c24 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:27.574635 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:27.654132 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-02745ab7-2be4-4a6d-b7a9-9e3853af7c24 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098314 Sep 05 12:36:27.654729 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 577/1141] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Sep 5 12:36:27 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:28.815152 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-6ba2f1ee-09d7-4852-8050-9ef06741823f req-3c63993d-0080-411b-a2fd-8026fa92c033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874bbcea-ca61-4335-aca0-c14a1c9a5314", "tag": "304a7c2a-fa78-4fe8-bd48-e89f01cc8d8d"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:36:28.820707 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:28.826270 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6ba2f1ee-09d7-4852-8050-9ef06741823f req-3c63993d-0080-411b-a2fd-8026fa92c033 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:28.826741 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6ba2f1ee-09d7-4852-8050-9ef06741823f req-3c63993d-0080-411b-a2fd-8026fa92c033 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:28.827171 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-6ba2f1ee-09d7-4852-8050-9ef06741823f req-3c63993d-0080-411b-a2fd-8026fa92c033 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:28.831077 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:28.840170 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-6ba2f1ee-09d7-4852-8050-9ef06741823f req-3c63993d-0080-411b-a2fd-8026fa92c033 service nova] Creating event network-changed:304a7c2a-fa78-4fe8-bd48-e89f01cc8d8d for instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 on hv-cinder-85518 Sep 05 12:36:28.846038 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-6ba2f1ee-09d7-4852-8050-9ef06741823f req-3c63993d-0080-411b-a2fd-8026fa92c033 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034473 Sep 05 12:36:28.846644 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 565/1142] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:37:42.609656 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:42.610516 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=3 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:42.612015 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:37:42.612249 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Mon Sep 5 12:37:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314/ips (ip 10.222.0.16) !!! Sep 05 12:37:42.617593 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-e4eadf94-f1b6-405c-b89d-46cf25c43ce6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:42.618089 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-e4eadf94-f1b6-405c-b89d-46cf25c43ce6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:42.626487 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e4eadf94-f1b6-405c-b89d-46cf25c43ce6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:42.626911 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e4eadf94-f1b6-405c-b89d-46cf25c43ce6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:42.627346 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e4eadf94-f1b6-405c-b89d-46cf25c43ce6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:42.628074 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e4eadf94-f1b6-405c-b89d-46cf25c43ce6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:42.628527 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e4eadf94-f1b6-405c-b89d-46cf25c43ce6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:42.628955 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-e4eadf94-f1b6-405c-b89d-46cf25c43ce6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:42.652630 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-e4eadf94-f1b6-405c-b89d-46cf25c43ce6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314/ips" status: 200 len: 150 microversion: 2.1 time: 0.044945 Sep 05 12:37:42.653185 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 578/1143] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Sep 5 12:37:42 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:37:43.982551 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-f38d2c70-20d7-4461-bf04-2039a027baf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8750b937-4cf1-457c-b241-44cd73129b25"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:37:43.985003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-f38d2c70-20d7-4461-bf04-2039a027baf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:43.992212 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f38d2c70-20d7-4461-bf04-2039a027baf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:43.992687 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f38d2c70-20d7-4461-bf04-2039a027baf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:43.993114 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f38d2c70-20d7-4461-bf04-2039a027baf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:43.993795 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f38d2c70-20d7-4461-bf04-2039a027baf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:43.994856 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f38d2c70-20d7-4461-bf04-2039a027baf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:43.995279 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-f38d2c70-20d7-4461-bf04-2039a027baf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:44.253475 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-f38d2c70-20d7-4461-bf04-2039a027baf7 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "POST /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279062 Sep 05 12:37:44.254091 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 566/1144] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Sep 5 12:37:43 2022] POST /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:37:51.883592 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-351e383b-fc71-4cc9-994f-7b6e5001d3f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:51.884089 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-351e383b-fc71-4cc9-994f-7b6e5001d3f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:51.890441 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-351e383b-fc71-4cc9-994f-7b6e5001d3f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:51.890921 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-351e383b-fc71-4cc9-994f-7b6e5001d3f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:51.891360 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-351e383b-fc71-4cc9-994f-7b6e5001d3f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:51.892338 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-351e383b-fc71-4cc9-994f-7b6e5001d3f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:51.892792 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-351e383b-fc71-4cc9-994f-7b6e5001d3f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:51.893222 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-351e383b-fc71-4cc9-994f-7b6e5001d3f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:51.972549 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.objects.instance [None req-351e383b-fc71-4cc9-994f-7b6e5001d3f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lazy-loading 'services' on Instance uuid 874bbcea-ca61-4335-aca0-c14a1c9a5314 {{(pid=120535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:37:52.044095 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-351e383b-fc71-4cc9-994f-7b6e5001d3f2 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314/os-volume_attachments/8750b937-4cf1-457c-b241-44cd73129b25" status: 202 len: 0 microversion: 2.1 time: 0.164383 Sep 05 12:37:52.044683 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 579/1145] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Sep 5 12:37:51 2022] DELETE /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314/os-volume_attachments/8750b937-4cf1-457c-b241-44cd73129b25 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:37:52.054850 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-bb8d83a1-23ca-4072-a363-6e78bfe1d30c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:52.057408 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-bb8d83a1-23ca-4072-a363-6e78bfe1d30c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:52.064408 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb8d83a1-23ca-4072-a363-6e78bfe1d30c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:52.065499 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb8d83a1-23ca-4072-a363-6e78bfe1d30c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:52.065937 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb8d83a1-23ca-4072-a363-6e78bfe1d30c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:52.066795 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb8d83a1-23ca-4072-a363-6e78bfe1d30c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:52.067246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb8d83a1-23ca-4072-a363-6e78bfe1d30c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:52.067715 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-bb8d83a1-23ca-4072-a363-6e78bfe1d30c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:52.098536 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-bb8d83a1-23ca-4072-a363-6e78bfe1d30c tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049192 Sep 05 12:37:52.099098 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 567/1146] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:37:52 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:37:53.112919 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-83ffb0f8-fa62-4284-8148-71280d80e7ee tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:53.115258 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-83ffb0f8-fa62-4284-8148-71280d80e7ee tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:53.121479 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-83ffb0f8-fa62-4284-8148-71280d80e7ee tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:53.121959 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-83ffb0f8-fa62-4284-8148-71280d80e7ee tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:53.122393 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-83ffb0f8-fa62-4284-8148-71280d80e7ee tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:53.123075 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-83ffb0f8-fa62-4284-8148-71280d80e7ee tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:53.123551 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-83ffb0f8-fa62-4284-8148-71280d80e7ee tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:53.123969 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-83ffb0f8-fa62-4284-8148-71280d80e7ee tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:53.151987 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-83ffb0f8-fa62-4284-8148-71280d80e7ee tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043974 Sep 05 12:37:53.153004 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 580/1147] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:37:53 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:37:53.214415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a2880624-3a32-463e-829f-c46a8c374e8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:53.214926 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a2880624-3a32-463e-829f-c46a8c374e8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:53.221758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2880624-3a32-463e-829f-c46a8c374e8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:53.222242 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2880624-3a32-463e-829f-c46a8c374e8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:53.222683 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2880624-3a32-463e-829f-c46a8c374e8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:53.223374 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2880624-3a32-463e-829f-c46a8c374e8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:53.223863 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2880624-3a32-463e-829f-c46a8c374e8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:53.224295 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a2880624-3a32-463e-829f-c46a8c374e8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:53.250249 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a2880624-3a32-463e-829f-c46a8c374e8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Going to try to terminate instance {{(pid=120534) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:37:53.325048 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a2880624-3a32-463e-829f-c46a8c374e8a tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 204 len: 0 microversion: 2.1 time: 0.113701 Sep 05 12:37:53.325955 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 568/1148] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:37:53 2022] DELETE /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:37:53.334337 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-c866ae04-9884-4858-bdd0-db9ddfad824e tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:53.334948 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-c866ae04-9884-4858-bdd0-db9ddfad824e tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:53.341370 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c866ae04-9884-4858-bdd0-db9ddfad824e tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:53.341841 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c866ae04-9884-4858-bdd0-db9ddfad824e tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:53.342271 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c866ae04-9884-4858-bdd0-db9ddfad824e tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:53.342952 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c866ae04-9884-4858-bdd0-db9ddfad824e tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:53.343409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c866ae04-9884-4858-bdd0-db9ddfad824e tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:53.343860 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-c866ae04-9884-4858-bdd0-db9ddfad824e tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:53.475372 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-c866ae04-9884-4858-bdd0-db9ddfad824e tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:53.483029 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-c866ae04-9884-4858-bdd0-db9ddfad824e tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1682 microversion: 2.1 time: 0.152778 Sep 05 12:37:53.483603 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 581/1149] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:53 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:54.506480 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-973ea2c7-9ab7-461f-b713-46d531ae2a0d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:54.507183 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-973ea2c7-9ab7-461f-b713-46d531ae2a0d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:54.513747 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-973ea2c7-9ab7-461f-b713-46d531ae2a0d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:54.514228 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-973ea2c7-9ab7-461f-b713-46d531ae2a0d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:54.514665 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-973ea2c7-9ab7-461f-b713-46d531ae2a0d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:54.515359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-973ea2c7-9ab7-461f-b713-46d531ae2a0d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:54.515838 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-973ea2c7-9ab7-461f-b713-46d531ae2a0d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:54.516266 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-973ea2c7-9ab7-461f-b713-46d531ae2a0d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:54.645996 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-973ea2c7-9ab7-461f-b713-46d531ae2a0d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:54.654168 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-973ea2c7-9ab7-461f-b713-46d531ae2a0d tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1682 microversion: 2.1 time: 0.151954 Sep 05 12:37:54.654724 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 569/1150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:54 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:55.678126 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-09ccdb11-31fc-4d59-b667-0cd0e34cc470 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:55.678750 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-09ccdb11-31fc-4d59-b667-0cd0e34cc470 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:55.685833 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-09ccdb11-31fc-4d59-b667-0cd0e34cc470 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:55.686320 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-09ccdb11-31fc-4d59-b667-0cd0e34cc470 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:55.686756 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-09ccdb11-31fc-4d59-b667-0cd0e34cc470 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:55.687449 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-09ccdb11-31fc-4d59-b667-0cd0e34cc470 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:55.687952 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-09ccdb11-31fc-4d59-b667-0cd0e34cc470 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:55.688377 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-09ccdb11-31fc-4d59-b667-0cd0e34cc470 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:55.928697 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-09ccdb11-31fc-4d59-b667-0cd0e34cc470 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee580cfc10dd4536b0709e65e3d23d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3972b5b8b24e999998d2616531f9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:55.936512 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-09ccdb11-31fc-4d59-b667-0cd0e34cc470 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 200 len: 1682 microversion: 2.1 time: 0.262285 Sep 05 12:37:55.937084 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 582/1151] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:55 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 1682 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:56.192058 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-d5d0946b-ff87-43ae-a2f8-2811c3d47c65 req-7331c179-e9c3-4a7c-87f5-d14ddfeaea8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874bbcea-ca61-4335-aca0-c14a1c9a5314", "name": "network-vif-deleted", "tag": "304a7c2a-fa78-4fe8-bd48-e89f01cc8d8d"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:37:56.203395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-d5d0946b-ff87-43ae-a2f8-2811c3d47c65 req-7331c179-e9c3-4a7c-87f5-d14ddfeaea8d service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:56.203903 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-d5d0946b-ff87-43ae-a2f8-2811c3d47c65 req-7331c179-e9c3-4a7c-87f5-d14ddfeaea8d service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:56.204333 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-d5d0946b-ff87-43ae-a2f8-2811c3d47c65 req-7331c179-e9c3-4a7c-87f5-d14ddfeaea8d service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:56.218497 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-d5d0946b-ff87-43ae-a2f8-2811c3d47c65 req-7331c179-e9c3-4a7c-87f5-d14ddfeaea8d service nova] Creating event network-vif-deleted:304a7c2a-fa78-4fe8-bd48-e89f01cc8d8d for instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 on hv-cinder-85518 Sep 05 12:37:56.224425 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-d5d0946b-ff87-43ae-a2f8-2811c3d47c65 req-7331c179-e9c3-4a7c-87f5-d14ddfeaea8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035758 Sep 05 12:37:56.226214 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 570/1152] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:37:56.959922 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0df1bd62-bb7e-496e-adf6-325721136208 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:56.960622 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-0df1bd62-bb7e-496e-adf6-325721136208 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:56.967264 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0df1bd62-bb7e-496e-adf6-325721136208 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:56.967771 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0df1bd62-bb7e-496e-adf6-325721136208 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:56.968269 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0df1bd62-bb7e-496e-adf6-325721136208 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:56.968966 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0df1bd62-bb7e-496e-adf6-325721136208 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:56.969447 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0df1bd62-bb7e-496e-adf6-325721136208 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:56.969866 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-0df1bd62-bb7e-496e-adf6-325721136208 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:56.983840 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-0df1bd62-bb7e-496e-adf6-325721136208 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] HTTP exception thrown: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0df1bd62-bb7e-496e-adf6-325721136208 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Request method failure captured: Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 HTTP/1.1 Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFevbiPOhfWakBg3IVNlM2z9awKnqcWXEXE6jd60IlWvr06bkTobODUMmVlgk4EZARnR8xj6eOknNEMDHft90bVE1X13zu3SJw17J3mnuQG4esDJYolpUwF3G-wm0_7mTBIPn9061RQE0yvRD_YUhaVGIPYeeRpfG_-GH9f1mUHiqs3E Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:37:56.985471 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:37:56.987086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d3972b5b8b24e999998d2616531f9e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}] Sep 05 12:37:56.987086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:37:56.987086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:37:56.987086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:37:56.987086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:37:56.987086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:37:56.987086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:37:56.987086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: ee580cfc10dd4536b0709e65e3d23d4d Sep 05 12:37:56.987086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:37:56.987086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:37:56.987086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:56.987086 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '874bbcea-ca61-4335-aca0-c14a1c9a5314'} Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:37:56.988412 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:56.989902 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:56.991685 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-0df1bd62-bb7e-496e-adf6-325721136208 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Returning 404 to user: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:37:56.991685 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-0df1bd62-bb7e-496e-adf6-325721136208 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 404 len: 111 microversion: 2.1 time: 0.031632 Sep 05 12:37:56.991685 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 583/1153] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:56 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:37:56.996807 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-6beb6a4b-59c3-4b0d-8956-0bf0b14ce2fb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '.version_select at 0x7fba4b9df1f0>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:57.017596 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-6beb6a4b-59c3-4b0d-8956-0bf0b14ce2fb tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1369862171" status: 202 len: 0 microversion: 2.1 time: 0.025003 Sep 05 12:37:57.018400 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 571/1154] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Sep 5 12:37:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1369862171 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:37:58.769997 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-217d415e-b9bb-4f02-8250-425172e4af45 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:58.770520 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-217d415e-b9bb-4f02-8250-425172e4af45 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:58.776814 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-217d415e-b9bb-4f02-8250-425172e4af45 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:58.777286 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-217d415e-b9bb-4f02-8250-425172e4af45 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:58.777713 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-217d415e-b9bb-4f02-8250-425172e4af45 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:58.778387 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-217d415e-b9bb-4f02-8250-425172e4af45 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:58.778832 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-217d415e-b9bb-4f02-8250-425172e4af45 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:58.779249 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-217d415e-b9bb-4f02-8250-425172e4af45 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:58.792211 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-217d415e-b9bb-4f02-8250-425172e4af45 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] HTTP exception thrown: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-217d415e-b9bb-4f02-8250-425172e4af45 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Request method failure captured: Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: DELETE /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 HTTP/1.1 Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFevbiPOhfWakBg3IVNlM2z9awKnqcWXEXE6jd60IlWvr06bkTobODUMmVlgk4EZARnR8xj6eOknNEMDHft90bVE1X13zu3SJw17J3mnuQG4esDJYolpUwF3G-wm0_7mTBIPn9061RQE0yvRD_YUhaVGIPYeeRpfG_-GH9f1mUHiqs3E Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:37:58.794209 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:37:58.796016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d3972b5b8b24e999998d2616531f9e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}] Sep 05 12:37:58.796016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:37:58.796016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:37:58.796016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:37:58.796016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:37:58.796016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:37:58.796016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:37:58.796016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: ee580cfc10dd4536b0709e65e3d23d4d Sep 05 12:37:58.796016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:37:58.796016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:37:58.796016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:58.796016 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '874bbcea-ca61-4335-aca0-c14a1c9a5314'} Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:37:58.797205 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:58.799063 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:58.800861 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-217d415e-b9bb-4f02-8250-425172e4af45 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Returning 404 to user: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:37:58.800861 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-217d415e-b9bb-4f02-8250-425172e4af45 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 404 len: 111 microversion: 2.1 time: 0.029688 Sep 05 12:37:58.800861 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 584/1155] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:37:58 2022] DELETE /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:37:58.803806 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-eb5807be-a387-428d-8799-7abc1e909edf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:58.804542 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-eb5807be-a387-428d-8799-7abc1e909edf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 874bbcea-ca61-4335-aca0-c14a1c9a5314] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:58.811986 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eb5807be-a387-428d-8799-7abc1e909edf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:58.812467 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eb5807be-a387-428d-8799-7abc1e909edf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:58.812909 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eb5807be-a387-428d-8799-7abc1e909edf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:58.813595 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eb5807be-a387-428d-8799-7abc1e909edf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:58.814051 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eb5807be-a387-428d-8799-7abc1e909edf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:58.814479 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-eb5807be-a387-428d-8799-7abc1e909edf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:58.827292 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-eb5807be-a387-428d-8799-7abc1e909edf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] HTTP exception thrown: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-eb5807be-a387-428d-8799-7abc1e909edf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Request method failure captured: Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 HTTP/1.1 Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFevbiPOhfWakBg3IVNlM2z9awKnqcWXEXE6jd60IlWvr06bkTobODUMmVlgk4EZARnR8xj6eOknNEMDHft90bVE1X13zu3SJw17J3mnuQG4esDJYolpUwF3G-wm0_7mTBIPn9061RQE0yvRD_YUhaVGIPYeeRpfG_-GH9f1mUHiqs3E Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:37:58.828910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:37:58.830625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d3972b5b8b24e999998d2616531f9e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}] Sep 05 12:37:58.830625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:37:58.830625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:37:58.830625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:37:58.830625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:37:58.830625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:37:58.830625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:37:58.830625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: ee580cfc10dd4536b0709e65e3d23d4d Sep 05 12:37:58.830625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:37:58.830625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:37:58.830625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:58.830625 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '874bbcea-ca61-4335-aca0-c14a1c9a5314'} Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:37:58.831667 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. Sep 05 12:37:58.833263 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:37:58.834841 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-eb5807be-a387-428d-8799-7abc1e909edf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Returning 404 to user: Instance 874bbcea-ca61-4335-aca0-c14a1c9a5314 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:37:58.834841 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-eb5807be-a387-428d-8799-7abc1e909edf tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314" status: 404 len: 111 microversion: 2.1 time: 0.030367 Sep 05 12:37:58.834841 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 572/1156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:58 2022] GET /compute/v2.1/servers/874bbcea-ca61-4335-aca0-c14a1c9a5314 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:37:59.966554 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8b7adb3e-0202-4238-88fd-d7ae7068a0f5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:59.967056 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8b7adb3e-0202-4238-88fd-d7ae7068a0f5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:59.973496 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8b7adb3e-0202-4238-88fd-d7ae7068a0f5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:59.973976 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8b7adb3e-0202-4238-88fd-d7ae7068a0f5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:59.974411 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8b7adb3e-0202-4238-88fd-d7ae7068a0f5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:59.975096 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8b7adb3e-0202-4238-88fd-d7ae7068a0f5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:59.975572 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8b7adb3e-0202-4238-88fd-d7ae7068a0f5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:59.975999 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8b7adb3e-0202-4238-88fd-d7ae7068a0f5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:59.989173 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-8b7adb3e-0202-4238-88fd-d7ae7068a0f5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] HTTP exception thrown: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8b7adb3e-0202-4238-88fd-d7ae7068a0f5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Request method failure captured: Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: DELETE /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b HTTP/1.1 Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFevbiPOhfWakBg3IVNlM2z9awKnqcWXEXE6jd60IlWvr06bkTobODUMmVlgk4EZARnR8xj6eOknNEMDHft90bVE1X13zu3SJw17J3mnuQG4esDJYolpUwF3G-wm0_7mTBIPn9061RQE0yvRD_YUhaVGIPYeeRpfG_-GH9f1mUHiqs3E Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:37:59.990778 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:37:59.992538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d3972b5b8b24e999998d2616531f9e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}] Sep 05 12:37:59.992538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:37:59.992538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:37:59.992538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:37:59.992538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:37:59.992538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:37:59.992538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:37:59.992538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: ee580cfc10dd4536b0709e65e3d23d4d Sep 05 12:37:59.992538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:37:59.992538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:37:59.992538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:37:59.992538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '27958846-c92c-487b-a866-83591259f73b'} Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:37:59.993434 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:37:59.994811 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:37:59.996698 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8b7adb3e-0202-4238-88fd-d7ae7068a0f5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Returning 404 to user: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:37:59.996698 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8b7adb3e-0202-4238-88fd-d7ae7068a0f5 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 404 len: 111 microversion: 2.1 time: 0.029461 Sep 05 12:37:59.996698 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 585/1157] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:37:59 2022] DELETE /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:38:00.000912 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a54d0b21-0266-4956-9f2d-c41986b350b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:00.001530 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-a54d0b21-0266-4956-9f2d-c41986b350b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 27958846-c92c-487b-a866-83591259f73b] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:00.008128 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a54d0b21-0266-4956-9f2d-c41986b350b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:00.008609 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a54d0b21-0266-4956-9f2d-c41986b350b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:00.009155 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a54d0b21-0266-4956-9f2d-c41986b350b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:00.009845 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a54d0b21-0266-4956-9f2d-c41986b350b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:00.010296 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a54d0b21-0266-4956-9f2d-c41986b350b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:00.010777 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-a54d0b21-0266-4956-9f2d-c41986b350b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:00.025096 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-a54d0b21-0266-4956-9f2d-c41986b350b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] HTTP exception thrown: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a54d0b21-0266-4956-9f2d-c41986b350b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Request method failure captured: Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b HTTP/1.1 Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFevbiPOhfWakBg3IVNlM2z9awKnqcWXEXE6jd60IlWvr06bkTobODUMmVlgk4EZARnR8xj6eOknNEMDHft90bVE1X13zu3SJw17J3mnuQG4esDJYolpUwF3G-wm0_7mTBIPn9061RQE0yvRD_YUhaVGIPYeeRpfG_-GH9f1mUHiqs3E Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:38:00.026593 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:38:00.028358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d3972b5b8b24e999998d2616531f9e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}] Sep 05 12:38:00.028358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:00.028358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:38:00.028358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:00.028358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:38:00.028358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:38:00.028358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:38:00.028358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: ee580cfc10dd4536b0709e65e3d23d4d Sep 05 12:38:00.028358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:38:00.028358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:38:00.028358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:38:00.028358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '27958846-c92c-487b-a866-83591259f73b'} Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:38:00.029346 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. Sep 05 12:38:00.031050 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.032811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-a54d0b21-0266-4956-9f2d-c41986b350b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Returning 404 to user: Instance 27958846-c92c-487b-a866-83591259f73b could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:38:00.032811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-a54d0b21-0266-4956-9f2d-c41986b350b6 tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b" status: 404 len: 111 microversion: 2.1 time: 0.030938 Sep 05 12:38:00.032811 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 573/1158] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:59 2022] GET /compute/v2.1/servers/27958846-c92c-487b-a866-83591259f73b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:38:00.036034 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-399faa92-ce4a-49e6-9fd5-91bc14e3698f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:00.036552 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-399faa92-ce4a-49e6-9fd5-91bc14e3698f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:00.042392 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-399faa92-ce4a-49e6-9fd5-91bc14e3698f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:00.043832 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-399faa92-ce4a-49e6-9fd5-91bc14e3698f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:00.044289 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-399faa92-ce4a-49e6-9fd5-91bc14e3698f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:00.044965 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-399faa92-ce4a-49e6-9fd5-91bc14e3698f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:00.045411 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-399faa92-ce4a-49e6-9fd5-91bc14e3698f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:00.045829 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-399faa92-ce4a-49e6-9fd5-91bc14e3698f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:00.061085 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-399faa92-ce4a-49e6-9fd5-91bc14e3698f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] HTTP exception thrown: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-399faa92-ce4a-49e6-9fd5-91bc14e3698f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Request method failure captured: Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: DELETE /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 HTTP/1.1 Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFevbiPOhfWakBg3IVNlM2z9awKnqcWXEXE6jd60IlWvr06bkTobODUMmVlgk4EZARnR8xj6eOknNEMDHft90bVE1X13zu3SJw17J3mnuQG4esDJYolpUwF3G-wm0_7mTBIPn9061RQE0yvRD_YUhaVGIPYeeRpfG_-GH9f1mUHiqs3E Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:38:00.062575 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:38:00.064310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d3972b5b8b24e999998d2616531f9e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}] Sep 05 12:38:00.064310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:00.064310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:38:00.064310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:00.064310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:38:00.064310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:38:00.064310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:38:00.064310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: ee580cfc10dd4536b0709e65e3d23d4d Sep 05 12:38:00.064310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:38:00.064310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:38:00.064310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:38:00.064310 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '17707518-9625-4f2a-9c46-a3efa0079962'} Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:38:00.065409 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:38:00.067026 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.068773 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-399faa92-ce4a-49e6-9fd5-91bc14e3698f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Returning 404 to user: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:38:00.068773 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-399faa92-ce4a-49e6-9fd5-91bc14e3698f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 404 len: 111 microversion: 2.1 time: 0.031651 Sep 05 12:38:00.068773 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 586/1159] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:38:00 2022] DELETE /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:38:00.071949 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e069675e-f7b6-407d-86e1-5bad7ff1f5dd tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:00.072555 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e069675e-f7b6-407d-86e1-5bad7ff1f5dd tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 17707518-9625-4f2a-9c46-a3efa0079962] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:00.078424 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e069675e-f7b6-407d-86e1-5bad7ff1f5dd tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:00.078901 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e069675e-f7b6-407d-86e1-5bad7ff1f5dd tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:00.079336 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e069675e-f7b6-407d-86e1-5bad7ff1f5dd tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:00.080054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e069675e-f7b6-407d-86e1-5bad7ff1f5dd tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:00.080504 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e069675e-f7b6-407d-86e1-5bad7ff1f5dd tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:00.080931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e069675e-f7b6-407d-86e1-5bad7ff1f5dd tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:00.093795 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-e069675e-f7b6-407d-86e1-5bad7ff1f5dd tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] HTTP exception thrown: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e069675e-f7b6-407d-86e1-5bad7ff1f5dd tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Request method failure captured: Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 HTTP/1.1 Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFevbiPOhfWakBg3IVNlM2z9awKnqcWXEXE6jd60IlWvr06bkTobODUMmVlgk4EZARnR8xj6eOknNEMDHft90bVE1X13zu3SJw17J3mnuQG4esDJYolpUwF3G-wm0_7mTBIPn9061RQE0yvRD_YUhaVGIPYeeRpfG_-GH9f1mUHiqs3E Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:38:00.095268 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:38:00.097020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d3972b5b8b24e999998d2616531f9e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}] Sep 05 12:38:00.097020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:00.097020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:38:00.097020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:00.097020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:38:00.097020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:38:00.097020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:38:00.097020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: ee580cfc10dd4536b0709e65e3d23d4d Sep 05 12:38:00.097020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:38:00.097020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:38:00.097020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:38:00.097020 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '17707518-9625-4f2a-9c46-a3efa0079962'} Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:38:00.098047 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. Sep 05 12:38:00.099668 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:00.101290 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e069675e-f7b6-407d-86e1-5bad7ff1f5dd tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Returning 404 to user: Instance 17707518-9625-4f2a-9c46-a3efa0079962 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:38:00.101290 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e069675e-f7b6-407d-86e1-5bad7ff1f5dd tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962" status: 404 len: 111 microversion: 2.1 time: 0.028400 Sep 05 12:38:00.101290 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 574/1160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:00 2022] GET /compute/v2.1/servers/17707518-9625-4f2a-9c46-a3efa0079962 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 12:38:01.236448 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-af824e69-d727-4fb5-a46c-c55e783c1cab tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:01.236962 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-af824e69-d727-4fb5-a46c-c55e783c1cab tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:01.244323 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af824e69-d727-4fb5-a46c-c55e783c1cab tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:01.244810 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af824e69-d727-4fb5-a46c-c55e783c1cab tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:01.245235 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af824e69-d727-4fb5-a46c-c55e783c1cab tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:01.245923 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af824e69-d727-4fb5-a46c-c55e783c1cab tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:01.246860 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af824e69-d727-4fb5-a46c-c55e783c1cab tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:01.247287 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-af824e69-d727-4fb5-a46c-c55e783c1cab tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:01.261680 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.wsgi [None req-af824e69-d727-4fb5-a46c-c55e783c1cab tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] HTTP exception thrown: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-af824e69-d727-4fb5-a46c-c55e783c1cab tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Request method failure captured: Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: request: DELETE /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca HTTP/1.1 Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept: application/json Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Accept-Encoding: identity Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Connection: close Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Length: 0 Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Content-Type: application/json Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Host: 10.222.0.16 Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Openstack-System-Scope: None Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: User-Agent: python-urllib3/1.26.12 Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Auth-Token: gAAAAABjFevbiPOhfWakBg3IVNlM2z9awKnqcWXEXE6jd60IlWvr06bkTobODUMmVlgk4EZARnR8xj6eOknNEMDHft90bVE1X13zu3SJw17J3mnuQG4esDJYolpUwF3G-wm0_7mTBIPn9061RQE0yvRD_YUhaVGIPYeeRpfG_-GH9f1mUHiqs3E Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Id: None Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Domain-Name: None Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Identity-Status: Confirmed Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Is-Admin-Project: True Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Id: default Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Domain-Name: Default Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Project-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Role: reader,member Sep 05 12:38:01.263878 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Roles: reader,member Sep 05 12:38:01.265615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d3972b5b8b24e999998d2616531f9e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}] Sep 05 12:38:01.265615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:01.265615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:38:01.265615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:01.265615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:38:01.265615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Id: default Sep 05 12:38:01.265615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Domain-Name: Default Sep 05 12:38:01.265615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Id: ee580cfc10dd4536b0709e65e3d23d4d Sep 05 12:38:01.265615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: X-User-Name: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:38:01.265615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: method: > Sep 05 12:38:01.265615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: exception: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:38:01.265615 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: action_args: {'id': '9c2c88ae-7231-41ce-89c5-c82c379fd3ca'} Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:38:01.266555 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:38:01.268440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR nova.api.openstack.wsgi Sep 05 12:38:01.270070 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-af824e69-d727-4fb5-a46c-c55e783c1cab tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Returning 404 to user: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. {{(pid=120535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:38:01.270070 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-af824e69-d727-4fb5-a46c-c55e783c1cab tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 404 len: 111 microversion: 2.1 time: 0.032766 Sep 05 12:38:01.270070 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 587/1161] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:38:01 2022] DELETE /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:38:01.274088 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b2d2f1e8-3391-48ef-8e92-71229c4c8e9f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:01.274705 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-b2d2f1e8-3391-48ef-8e92-71229c4c8e9f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] [instance: 9c2c88ae-7231-41ce-89c5-c82c379fd3ca] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:01.281700 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b2d2f1e8-3391-48ef-8e92-71229c4c8e9f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:01.282438 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b2d2f1e8-3391-48ef-8e92-71229c4c8e9f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:01.282881 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b2d2f1e8-3391-48ef-8e92-71229c4c8e9f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:01.283612 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b2d2f1e8-3391-48ef-8e92-71229c4c8e9f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:01.284072 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b2d2f1e8-3391-48ef-8e92-71229c4c8e9f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:01.284503 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-b2d2f1e8-3391-48ef-8e92-71229c4c8e9f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:01.299882 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-b2d2f1e8-3391-48ef-8e92-71229c4c8e9f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] HTTP exception thrown: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b2d2f1e8-3391-48ef-8e92-71229c4c8e9f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Request method failure captured: Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca HTTP/1.1 Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFevbiPOhfWakBg3IVNlM2z9awKnqcWXEXE6jd60IlWvr06bkTobODUMmVlgk4EZARnR8xj6eOknNEMDHft90bVE1X13zu3SJw17J3mnuQG4esDJYolpUwF3G-wm0_7mTBIPn9061RQE0yvRD_YUhaVGIPYeeRpfG_-GH9f1mUHiqs3E Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:38:01.302177 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:38:01.303931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d3972b5b8b24e999998d2616531f9e7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d3972b5b8b24e999998d2616531f9e7"}]}] Sep 05 12:38:01.303931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:01.303931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 0d3972b5b8b24e999998d2616531f9e7 Sep 05 12:38:01.303931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-138307758 Sep 05 12:38:01.303931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:38:01.303931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:38:01.303931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:38:01.303931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: ee580cfc10dd4536b0709e65e3d23d4d Sep 05 12:38:01.303931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-AttachVolumeNegativeTest-138307758-project Sep 05 12:38:01.303931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:38:01.303931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:38:01.303931 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '9c2c88ae-7231-41ce-89c5-c82c379fd3ca'} Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:38:01.305021 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. Sep 05 12:38:01.306637 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:38:01.308103 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-b2d2f1e8-3391-48ef-8e92-71229c4c8e9f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] Returning 404 to user: Instance 9c2c88ae-7231-41ce-89c5-c82c379fd3ca could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:38:01.308103 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-b2d2f1e8-3391-48ef-8e92-71229c4c8e9f tempest-AttachVolumeNegativeTest-138307758 tempest-AttachVolumeNegativeTest-138307758-project] 10.222.0.16 "GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca" status: 404 len: 111 microversion: 2.1 time: 0.033297 Sep 05 12:38:01.308103 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 575/1162] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:01 2022] GET /compute/v2.1/servers/9c2c88ae-7231-41ce-89c5-c82c379fd3ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:39:12.552958 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=20 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:12.553704 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:12.558148 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6563da81-5def-4b85-b675-53e85dee0e7e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Action: 'create', calling method: .version_select at 0x7fba4f16c280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2056506735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOORg3rQ8PWSPQP7EOTY/XzHlQO0VXnTC8vSEPHRWa9VP1D+veM3q87tUMMRJ7ZyynZTyJgD9jdL77VVrrrwRxb4Le653lXcmi96lJ0XwG0ZD4pPnXEYZ/fHWEXKA1Kf4Q=="}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:12.574920 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-6563da81-5def-4b85-b675-53e85dee0e7e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Getting quotas for project 7282ae16ef3d42979dfe9616a6b16238. Resources: {'key_pairs'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:39:12.578733 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.quota [None req-6563da81-5def-4b85-b675-53e85dee0e7e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Getting quotas for user a2556517dad2454c8cbbf26c5a9ea764 and project 7282ae16ef3d42979dfe9616a6b16238. Resources: {'key_pairs'} {{(pid=120535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:39:12.590302 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6563da81-5def-4b85-b675-53e85dee0e7e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [4ac52161-8fbd-4a98-ba77-92a0b1dec3b9] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 05 12:39:13.598036 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO oslo.messaging._drivers.impl_rabbit [None req-6563da81-5def-4b85-b675-53e85dee0e7e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [4ac52161-8fbd-4a98-ba77-92a0b1dec3b9] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41860. Sep 05 12:39:13.613137 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6563da81-5def-4b85-b675-53e85dee0e7e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.062005 Sep 05 12:39:13.613723 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 588/1163] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Sep 5 12:39:12 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:39:13.664587 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1068702535", "imageRef": "e034b864-ae79-403c-843c-41a65cf64f4e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2056506735", "networks": [{"uuid": "8477fa9c-c3e5-424d-a757-0539268df1df"}]}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:13.673719 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:13.674359 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:13.720417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.network.neutron [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] validate_networks() for [('8477fa9c-c3e5-424d-a757-0539268df1df', None, None, None, None, None)] {{(pid=120534) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:39:14.177702 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Flavor limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:39:14.178116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Image limits 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:39:14.178617 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Flavor pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:39:14.179035 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Image pref 0:0:0 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:39:14.179418 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.virt.hardware [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:39:14.188008 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:14.188476 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:14.188908 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:14.189617 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:14.190061 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:14.190477 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:14.208469 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Getting quotas for project 7282ae16ef3d42979dfe9616a6b16238. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:39:14.212441 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.quota [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Getting quotas for user a2556517dad2454c8cbbf26c5a9ea764 and project 7282ae16ef3d42979dfe9616a6b16238. Resources: {'instances', 'cores', 'ram'} {{(pid=120534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:39:14.223684 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Going to run 1 instances... {{(pid=120534) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:39:14.226209 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e034b864-ae79-403c-843c-41a65cf64f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:39:14.270938 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR oslo.messaging._drivers.impl_rabbit [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [ce3456a5-b522-464e-b6c2-5133793aa28b] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 05 12:39:15.277474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO oslo.messaging._drivers.impl_rabbit [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [ce3456a5-b522-464e-b6c2-5133793aa28b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41878. Sep 05 12:39:15.281349 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-38927e27-2582-4da7-94bd-dc9508e285c5 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.621257 Sep 05 12:39:15.282002 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 576/1164] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Sep 5 12:39:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:39:15.293292 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b5034ce0-e277-4d3d-8c04-dcced1f3969e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:15.293910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b5034ce0-e277-4d3d-8c04-dcced1f3969e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:15.503552 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b5034ce0-e277-4d3d-8c04-dcced1f3969e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:15.510425 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b5034ce0-e277-4d3d-8c04-dcced1f3969e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1259 microversion: 2.1 time: 0.221454 Sep 05 12:39:15.511232 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 589/1165] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:15 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:16.536003 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-8d391beb-af9c-48ae-a320-0b2416138c5a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:16.536627 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-8d391beb-af9c-48ae-a320-0b2416138c5a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:16.542743 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8d391beb-af9c-48ae-a320-0b2416138c5a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:16.543229 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8d391beb-af9c-48ae-a320-0b2416138c5a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:16.543698 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8d391beb-af9c-48ae-a320-0b2416138c5a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:16.544397 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8d391beb-af9c-48ae-a320-0b2416138c5a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:16.544862 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8d391beb-af9c-48ae-a320-0b2416138c5a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:16.545292 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-8d391beb-af9c-48ae-a320-0b2416138c5a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:16.671909 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-8d391beb-af9c-48ae-a320-0b2416138c5a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:16.680319 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-8d391beb-af9c-48ae-a320-0b2416138c5a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1317 microversion: 2.1 time: 0.148692 Sep 05 12:39:16.681901 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 577/1166] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:16 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:17.703446 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-476e3408-0ec3-4f12-b145-62b7e6ad2c97 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:17.704324 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-476e3408-0ec3-4f12-b145-62b7e6ad2c97 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:17.711122 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-476e3408-0ec3-4f12-b145-62b7e6ad2c97 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:17.711777 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-476e3408-0ec3-4f12-b145-62b7e6ad2c97 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:17.712494 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-476e3408-0ec3-4f12-b145-62b7e6ad2c97 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:17.713436 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-476e3408-0ec3-4f12-b145-62b7e6ad2c97 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:17.714099 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-476e3408-0ec3-4f12-b145-62b7e6ad2c97 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:17.714742 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-476e3408-0ec3-4f12-b145-62b7e6ad2c97 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:17.852817 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-476e3408-0ec3-4f12-b145-62b7e6ad2c97 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:17.861149 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-476e3408-0ec3-4f12-b145-62b7e6ad2c97 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.162172 Sep 05 12:39:17.861813 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 590/1167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:17 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:18.885473 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-be95f9ff-cd88-4b28-8341-2744091ae780 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:18.887116 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-be95f9ff-cd88-4b28-8341-2744091ae780 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:18.895825 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-be95f9ff-cd88-4b28-8341-2744091ae780 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:18.896872 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-be95f9ff-cd88-4b28-8341-2744091ae780 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:18.898644 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-be95f9ff-cd88-4b28-8341-2744091ae780 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:18.899958 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-be95f9ff-cd88-4b28-8341-2744091ae780 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:18.900491 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-be95f9ff-cd88-4b28-8341-2744091ae780 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:18.900994 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-be95f9ff-cd88-4b28-8341-2744091ae780 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:19.042655 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-be95f9ff-cd88-4b28-8341-2744091ae780 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:19.050729 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-be95f9ff-cd88-4b28-8341-2744091ae780 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.170009 Sep 05 12:39:19.059415 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 578/1168] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:18 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:20.074222 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-2758eafc-3077-4054-aaf0-e3b9aaea30ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:20.074933 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-2758eafc-3077-4054-aaf0-e3b9aaea30ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:20.081836 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2758eafc-3077-4054-aaf0-e3b9aaea30ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:20.082327 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2758eafc-3077-4054-aaf0-e3b9aaea30ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:20.082763 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2758eafc-3077-4054-aaf0-e3b9aaea30ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:20.083548 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2758eafc-3077-4054-aaf0-e3b9aaea30ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:20.084040 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2758eafc-3077-4054-aaf0-e3b9aaea30ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:20.084466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-2758eafc-3077-4054-aaf0-e3b9aaea30ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:20.228070 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-2758eafc-3077-4054-aaf0-e3b9aaea30ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:20.236727 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-2758eafc-3077-4054-aaf0-e3b9aaea30ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.166272 Sep 05 12:39:20.245321 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 591/1169] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:20 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:21.260647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-751edb52-9850-438c-a483-c5b5252ca89e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:21.261184 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-751edb52-9850-438c-a483-c5b5252ca89e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:21.272122 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-751edb52-9850-438c-a483-c5b5252ca89e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:21.272558 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-751edb52-9850-438c-a483-c5b5252ca89e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:21.272995 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-751edb52-9850-438c-a483-c5b5252ca89e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:21.273706 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-751edb52-9850-438c-a483-c5b5252ca89e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:21.274157 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-751edb52-9850-438c-a483-c5b5252ca89e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:21.274705 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-751edb52-9850-438c-a483-c5b5252ca89e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:21.408986 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-751edb52-9850-438c-a483-c5b5252ca89e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:21.417188 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-751edb52-9850-438c-a483-c5b5252ca89e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.161110 Sep 05 12:39:21.417957 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 579/1170] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:21 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:22.440965 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b2d0516c-2669-4508-9a0d-f3612d7e6536 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:22.441689 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b2d0516c-2669-4508-9a0d-f3612d7e6536 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:22.448202 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b2d0516c-2669-4508-9a0d-f3612d7e6536 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:22.448674 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b2d0516c-2669-4508-9a0d-f3612d7e6536 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:22.449103 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b2d0516c-2669-4508-9a0d-f3612d7e6536 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:22.449810 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b2d0516c-2669-4508-9a0d-f3612d7e6536 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:22.450260 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b2d0516c-2669-4508-9a0d-f3612d7e6536 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:22.450809 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b2d0516c-2669-4508-9a0d-f3612d7e6536 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:22.584888 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b2d0516c-2669-4508-9a0d-f3612d7e6536 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:22.592704 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b2d0516c-2669-4508-9a0d-f3612d7e6536 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.156130 Sep 05 12:39:22.593519 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 592/1171] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:22 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:23.616936 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-da27be75-8149-461c-b0d4-716b5ec977c4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:23.617569 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-da27be75-8149-461c-b0d4-716b5ec977c4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:23.624442 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-da27be75-8149-461c-b0d4-716b5ec977c4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:23.624927 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-da27be75-8149-461c-b0d4-716b5ec977c4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:23.625358 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-da27be75-8149-461c-b0d4-716b5ec977c4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:23.626163 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-da27be75-8149-461c-b0d4-716b5ec977c4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:23.626599 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-da27be75-8149-461c-b0d4-716b5ec977c4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:23.627082 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-da27be75-8149-461c-b0d4-716b5ec977c4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:23.772758 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-da27be75-8149-461c-b0d4-716b5ec977c4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:23.781039 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-da27be75-8149-461c-b0d4-716b5ec977c4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.167935 Sep 05 12:39:23.781608 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 580/1172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:23 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:24.803895 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-7486556f-f416-4950-8c15-9be1f0db49ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:24.804504 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-7486556f-f416-4950-8c15-9be1f0db49ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:24.811609 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7486556f-f416-4950-8c15-9be1f0db49ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:24.812094 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7486556f-f416-4950-8c15-9be1f0db49ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:24.812528 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7486556f-f416-4950-8c15-9be1f0db49ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:24.813216 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7486556f-f416-4950-8c15-9be1f0db49ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:24.813670 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7486556f-f416-4950-8c15-9be1f0db49ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:24.814098 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-7486556f-f416-4950-8c15-9be1f0db49ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:24.939021 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-7486556f-f416-4950-8c15-9be1f0db49ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:24.946664 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-7486556f-f416-4950-8c15-9be1f0db49ee tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.146713 Sep 05 12:39:24.947234 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 593/1173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:24 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:25.969754 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ab296804-b969-4344-ad7a-b46f5d2c971d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:25.970297 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ab296804-b969-4344-ad7a-b46f5d2c971d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:25.972836 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:25.973494 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=6 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:25.980153 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ab296804-b969-4344-ad7a-b46f5d2c971d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:25.980635 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ab296804-b969-4344-ad7a-b46f5d2c971d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:25.981070 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ab296804-b969-4344-ad7a-b46f5d2c971d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:25.981760 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ab296804-b969-4344-ad7a-b46f5d2c971d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:25.982215 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ab296804-b969-4344-ad7a-b46f5d2c971d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:25.982645 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ab296804-b969-4344-ad7a-b46f5d2c971d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:26.110157 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-ab296804-b969-4344-ad7a-b46f5d2c971d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:26.117986 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ab296804-b969-4344-ad7a-b46f5d2c971d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.152200 Sep 05 12:39:26.118554 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 581/1174] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:25 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:27.141503 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1831564d-7661-4745-9eaa-e6489a9c6785 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:27.142352 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-1831564d-7661-4745-9eaa-e6489a9c6785 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:27.144688 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell0:SELECT=6 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:27.151832 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1831564d-7661-4745-9eaa-e6489a9c6785 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:27.152338 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1831564d-7661-4745-9eaa-e6489a9c6785 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:27.152759 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1831564d-7661-4745-9eaa-e6489a9c6785 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:27.153450 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1831564d-7661-4745-9eaa-e6489a9c6785 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:27.153906 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1831564d-7661-4745-9eaa-e6489a9c6785 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:27.154334 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1831564d-7661-4745-9eaa-e6489a9c6785 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:27.288312 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-1831564d-7661-4745-9eaa-e6489a9c6785 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:27.295966 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1831564d-7661-4745-9eaa-e6489a9c6785 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.159686 Sep 05 12:39:27.296526 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 594/1175] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:27 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:28.212419 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-acfee0b2-1fac-40f9-b196-04715c47157f req-d4109a77-bc6d-4a1f-8945-1ba6fd541df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27934571-ae5b-41c1-a9af-a1bb34972446", "tag": "66006a3c-ea4a-46c9-bbd5-3562760564bf"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:28.224474 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-acfee0b2-1fac-40f9-b196-04715c47157f req-d4109a77-bc6d-4a1f-8945-1ba6fd541df4 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:28.225028 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-acfee0b2-1fac-40f9-b196-04715c47157f req-d4109a77-bc6d-4a1f-8945-1ba6fd541df4 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:28.225673 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-acfee0b2-1fac-40f9-b196-04715c47157f req-d4109a77-bc6d-4a1f-8945-1ba6fd541df4 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:28.239837 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-acfee0b2-1fac-40f9-b196-04715c47157f req-d4109a77-bc6d-4a1f-8945-1ba6fd541df4 service nova] Creating event network-changed:66006a3c-ea4a-46c9-bbd5-3562760564bf for instance 27934571-ae5b-41c1-a9af-a1bb34972446 on hv-cinder-85518 Sep 05 12:39:28.245083 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-acfee0b2-1fac-40f9-b196-04715c47157f req-d4109a77-bc6d-4a1f-8945-1ba6fd541df4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037633 Sep 05 12:39:28.246033 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 582/1176] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:39:28.320005 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-18604259-23f7-4cb0-8421-3444d062d881 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:28.320722 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-18604259-23f7-4cb0-8421-3444d062d881 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:28.328074 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-18604259-23f7-4cb0-8421-3444d062d881 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:28.328569 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-18604259-23f7-4cb0-8421-3444d062d881 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:28.329007 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-18604259-23f7-4cb0-8421-3444d062d881 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:28.329712 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-18604259-23f7-4cb0-8421-3444d062d881 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:28.330916 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-18604259-23f7-4cb0-8421-3444d062d881 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:28.331356 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-18604259-23f7-4cb0-8421-3444d062d881 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:28.547466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-18604259-23f7-4cb0-8421-3444d062d881 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:28.555125 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-18604259-23f7-4cb0-8421-3444d062d881 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.240771 Sep 05 12:39:28.555719 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 595/1177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:28 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:29.578845 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-83d79ca9-5079-4a14-b4b4-7d358dc70d06 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:29.579602 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-83d79ca9-5079-4a14-b4b4-7d358dc70d06 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:29.586199 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-83d79ca9-5079-4a14-b4b4-7d358dc70d06 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:29.586681 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-83d79ca9-5079-4a14-b4b4-7d358dc70d06 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:29.587118 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-83d79ca9-5079-4a14-b4b4-7d358dc70d06 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:29.587835 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-83d79ca9-5079-4a14-b4b4-7d358dc70d06 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:29.588323 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-83d79ca9-5079-4a14-b4b4-7d358dc70d06 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:29.588752 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-83d79ca9-5079-4a14-b4b4-7d358dc70d06 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:29.717075 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-83d79ca9-5079-4a14-b4b4-7d358dc70d06 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:29.724674 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-83d79ca9-5079-4a14-b4b4-7d358dc70d06 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.150738 Sep 05 12:39:29.725235 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 583/1178] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:29 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:30.747282 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a918faa8-bcca-4e68-86f0-b6968a15751c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:30.747865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a918faa8-bcca-4e68-86f0-b6968a15751c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:30.754924 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a918faa8-bcca-4e68-86f0-b6968a15751c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:30.755407 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a918faa8-bcca-4e68-86f0-b6968a15751c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:30.755889 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a918faa8-bcca-4e68-86f0-b6968a15751c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:30.756581 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a918faa8-bcca-4e68-86f0-b6968a15751c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:30.757035 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a918faa8-bcca-4e68-86f0-b6968a15751c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:30.757463 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a918faa8-bcca-4e68-86f0-b6968a15751c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:30.969300 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a918faa8-bcca-4e68-86f0-b6968a15751c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:30.977019 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a918faa8-bcca-4e68-86f0-b6968a15751c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.233627 Sep 05 12:39:30.977596 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 596/1179] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:30 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:32.000615 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-56e45ddc-9168-4f0e-987b-b0e17eb1b407 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:32.001250 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-56e45ddc-9168-4f0e-987b-b0e17eb1b407 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:32.007678 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-56e45ddc-9168-4f0e-987b-b0e17eb1b407 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:32.008166 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-56e45ddc-9168-4f0e-987b-b0e17eb1b407 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:32.008604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-56e45ddc-9168-4f0e-987b-b0e17eb1b407 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:32.009306 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-56e45ddc-9168-4f0e-987b-b0e17eb1b407 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:32.009769 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-56e45ddc-9168-4f0e-987b-b0e17eb1b407 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:32.010201 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-56e45ddc-9168-4f0e-987b-b0e17eb1b407 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:32.141157 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-56e45ddc-9168-4f0e-987b-b0e17eb1b407 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:32.148825 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-56e45ddc-9168-4f0e-987b-b0e17eb1b407 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.152690 Sep 05 12:39:32.149390 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 584/1180] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:31 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:33.173011 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-068b6347-aa92-42ff-8c7e-1337edb7823a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:33.173605 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-068b6347-aa92-42ff-8c7e-1337edb7823a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:33.180144 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-068b6347-aa92-42ff-8c7e-1337edb7823a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:33.180625 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-068b6347-aa92-42ff-8c7e-1337edb7823a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:33.181059 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-068b6347-aa92-42ff-8c7e-1337edb7823a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:33.181745 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-068b6347-aa92-42ff-8c7e-1337edb7823a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:33.182203 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-068b6347-aa92-42ff-8c7e-1337edb7823a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:33.182629 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-068b6347-aa92-42ff-8c7e-1337edb7823a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:33.310215 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-068b6347-aa92-42ff-8c7e-1337edb7823a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:33.318297 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-068b6347-aa92-42ff-8c7e-1337edb7823a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.149104 Sep 05 12:39:33.318865 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 597/1181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:33 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:33.434223 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-bae681d5-47b8-4dc6-a0dc-d69d2252e062 req-e4e8f4e1-2eda-4186-a7dd-f82d91792376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27934571-ae5b-41c1-a9af-a1bb34972446", "name": "network-vif-plugged", "status": "completed", "tag": "66006a3c-ea4a-46c9-bbd5-3562760564bf"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:33.446803 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-bae681d5-47b8-4dc6-a0dc-d69d2252e062 req-e4e8f4e1-2eda-4186-a7dd-f82d91792376 service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:33.447297 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-bae681d5-47b8-4dc6-a0dc-d69d2252e062 req-e4e8f4e1-2eda-4186-a7dd-f82d91792376 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:33.447763 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-bae681d5-47b8-4dc6-a0dc-d69d2252e062 req-e4e8f4e1-2eda-4186-a7dd-f82d91792376 service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:33.460102 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-bae681d5-47b8-4dc6-a0dc-d69d2252e062 req-e4e8f4e1-2eda-4186-a7dd-f82d91792376 service nova] Creating event network-vif-plugged:66006a3c-ea4a-46c9-bbd5-3562760564bf for instance 27934571-ae5b-41c1-a9af-a1bb34972446 on hv-cinder-85518 Sep 05 12:39:33.465340 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-bae681d5-47b8-4dc6-a0dc-d69d2252e062 req-e4e8f4e1-2eda-4186-a7dd-f82d91792376 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034853 Sep 05 12:39:33.466114 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 585/1182] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:39:34.341908 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-aa4d137f-642d-481b-92f0-b001f649719a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:34.343015 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-aa4d137f-642d-481b-92f0-b001f649719a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:34.349425 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa4d137f-642d-481b-92f0-b001f649719a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:34.349916 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa4d137f-642d-481b-92f0-b001f649719a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:34.350357 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa4d137f-642d-481b-92f0-b001f649719a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:34.351047 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa4d137f-642d-481b-92f0-b001f649719a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:34.351508 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa4d137f-642d-481b-92f0-b001f649719a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:34.351961 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-aa4d137f-642d-481b-92f0-b001f649719a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:34.483400 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-aa4d137f-642d-481b-92f0-b001f649719a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:34.491011 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-aa4d137f-642d-481b-92f0-b001f649719a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1359 microversion: 2.1 time: 0.152950 Sep 05 12:39:34.491767 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 598/1183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:34 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:35.515157 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-87768bcb-3545-470c-8952-3452d683e126 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:35.516435 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-87768bcb-3545-470c-8952-3452d683e126 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:35.523081 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87768bcb-3545-470c-8952-3452d683e126 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:35.523500 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87768bcb-3545-470c-8952-3452d683e126 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:35.523982 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87768bcb-3545-470c-8952-3452d683e126 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:35.524659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87768bcb-3545-470c-8952-3452d683e126 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:35.525114 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87768bcb-3545-470c-8952-3452d683e126 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:35.525541 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-87768bcb-3545-470c-8952-3452d683e126 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:35.653179 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-87768bcb-3545-470c-8952-3452d683e126 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:35.661353 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-87768bcb-3545-470c-8952-3452d683e126 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1550 microversion: 2.1 time: 0.150693 Sep 05 12:39:35.661910 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 586/1184] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:35 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:35.683616 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-4a8aa905-5234-412d-a060-986378daed53 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:35.684231 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-4a8aa905-5234-412d-a060-986378daed53 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:35.690507 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4a8aa905-5234-412d-a060-986378daed53 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:35.690986 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4a8aa905-5234-412d-a060-986378daed53 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:35.691419 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4a8aa905-5234-412d-a060-986378daed53 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:35.692126 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4a8aa905-5234-412d-a060-986378daed53 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:35.692579 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4a8aa905-5234-412d-a060-986378daed53 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:35.693005 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-4a8aa905-5234-412d-a060-986378daed53 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:35.817298 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-4a8aa905-5234-412d-a060-986378daed53 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:35.825481 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-4a8aa905-5234-412d-a060-986378daed53 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1550 microversion: 2.1 time: 0.145681 Sep 05 12:39:35.826057 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 599/1185] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:35 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1550 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:35.847234 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-198866bb-e783-4d15-9393-1c78c0662ee9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:35.852106 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-198866bb-e783-4d15-9393-1c78c0662ee9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:35.852862 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-198866bb-e783-4d15-9393-1c78c0662ee9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Searching by: {'deleted': False, 'project_id': '7282ae16ef3d42979dfe9616a6b16238'} {{(pid=120534) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 05 12:39:35.862493 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-198866bb-e783-4d15-9393-1c78c0662ee9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:35.862969 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-198866bb-e783-4d15-9393-1c78c0662ee9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:35.863407 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-198866bb-e783-4d15-9393-1c78c0662ee9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:35.864156 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-198866bb-e783-4d15-9393-1c78c0662ee9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:35.864611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-198866bb-e783-4d15-9393-1c78c0662ee9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:35.865040 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-198866bb-e783-4d15-9393-1c78c0662ee9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:35.953488 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.multi_cell_list [None req-198866bb-e783-4d15-9393-1c78c0662ee9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120534) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 05 12:39:36.045632 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-198866bb-e783-4d15-9393-1c78c0662ee9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202071 Sep 05 12:39:36.046209 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 587/1186] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Sep 5 12:39:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:39:36.057603 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-16319266-04fa-4489-a4b4-8ace97c0a4c6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:36.058217 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-16319266-04fa-4489-a4b4-8ace97c0a4c6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:36.064100 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-16319266-04fa-4489-a4b4-8ace97c0a4c6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:36.064579 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-16319266-04fa-4489-a4b4-8ace97c0a4c6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:36.065057 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-16319266-04fa-4489-a4b4-8ace97c0a4c6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:36.065696 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-16319266-04fa-4489-a4b4-8ace97c0a4c6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:36.066146 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-16319266-04fa-4489-a4b4-8ace97c0a4c6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:36.066572 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-16319266-04fa-4489-a4b4-8ace97c0a4c6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:36.194997 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-16319266-04fa-4489-a4b4-8ace97c0a4c6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:36.203189 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-16319266-04fa-4489-a4b4-8ace97c0a4c6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1550 microversion: 2.1 time: 0.149414 Sep 05 12:39:36.203787 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 600/1187] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:36 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:37.739105 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-ca382964-6025-43fa-aad8-90196ca407b4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a647d7b9-1366-42d0-af62-c848b75db038"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:37.741438 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-ca382964-6025-43fa-aad8-90196ca407b4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:37.747733 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca382964-6025-43fa-aad8-90196ca407b4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:37.748214 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca382964-6025-43fa-aad8-90196ca407b4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:37.748647 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca382964-6025-43fa-aad8-90196ca407b4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:37.749328 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca382964-6025-43fa-aad8-90196ca407b4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:37.749771 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca382964-6025-43fa-aad8-90196ca407b4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:37.750192 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-ca382964-6025-43fa-aad8-90196ca407b4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:38.003048 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-ca382964-6025-43fa-aad8-90196ca407b4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "POST /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267279 Sep 05 12:39:38.003679 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 588/1188] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Sep 5 12:39:37 2022] POST /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:39:45.581764 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-6ec21fd2-0989-479e-b48a-49cfb62338b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:45.582377 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-6ec21fd2-0989-479e-b48a-49cfb62338b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:45.584592 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:45.589779 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6ec21fd2-0989-479e-b48a-49cfb62338b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:45.590263 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6ec21fd2-0989-479e-b48a-49cfb62338b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:45.590692 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6ec21fd2-0989-479e-b48a-49cfb62338b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:45.591377 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6ec21fd2-0989-479e-b48a-49cfb62338b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:45.591854 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6ec21fd2-0989-479e-b48a-49cfb62338b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:45.592313 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-6ec21fd2-0989-479e-b48a-49cfb62338b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:45.596987 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=67 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:45.722234 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-6ec21fd2-0989-479e-b48a-49cfb62338b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:45.730299 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-6ec21fd2-0989-479e-b48a-49cfb62338b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1596 microversion: 2.1 time: 0.152313 Sep 05 12:39:45.730861 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 601/1189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:45 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1596 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:47.579613 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-d0d701f9-fedf-4ca6-ac40-c43b7f5d6320 req-0dd1dba1-31b2-48f9-a16b-fadc3d7374af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27934571-ae5b-41c1-a9af-a1bb34972446", "tag": "66006a3c-ea4a-46c9-bbd5-3562760564bf"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:47.585313 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell0:SELECT=2 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:47.586472 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:47.593371 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-d0d701f9-fedf-4ca6-ac40-c43b7f5d6320 req-0dd1dba1-31b2-48f9-a16b-fadc3d7374af service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:47.593977 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-d0d701f9-fedf-4ca6-ac40-c43b7f5d6320 req-0dd1dba1-31b2-48f9-a16b-fadc3d7374af service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:47.594509 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-d0d701f9-fedf-4ca6-ac40-c43b7f5d6320 req-0dd1dba1-31b2-48f9-a16b-fadc3d7374af service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:47.612458 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:47.615161 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-d0d701f9-fedf-4ca6-ac40-c43b7f5d6320 req-0dd1dba1-31b2-48f9-a16b-fadc3d7374af service nova] Creating event network-changed:66006a3c-ea4a-46c9-bbd5-3562760564bf for instance 27934571-ae5b-41c1-a9af-a1bb34972446 on hv-cinder-85518 Sep 05 12:39:47.620683 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-d0d701f9-fedf-4ca6-ac40-c43b7f5d6320 req-0dd1dba1-31b2-48f9-a16b-fadc3d7374af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045144 Sep 05 12:39:47.621792 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 589/1190] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:39:48.766515 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-1ea184a6-ae73-4b5b-98d5-c4027592c006 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1182741039"}} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:48.767024 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-1ea184a6-ae73-4b5b-98d5-c4027592c006 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:48.773376 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1ea184a6-ae73-4b5b-98d5-c4027592c006 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:48.773851 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1ea184a6-ae73-4b5b-98d5-c4027592c006 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:48.774276 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1ea184a6-ae73-4b5b-98d5-c4027592c006 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:48.774946 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1ea184a6-ae73-4b5b-98d5-c4027592c006 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:48.775390 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1ea184a6-ae73-4b5b-98d5-c4027592c006 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:48.775832 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-1ea184a6-ae73-4b5b-98d5-c4027592c006 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:48.899569 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.network.security_group_api [None req-1ea184a6-ae73-4b5b-98d5-c4027592c006 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Adding security group b5ab1468-5300-40dd-9890-5555342b9deb to port 66006a3c-ea4a-46c9-bbd5-3562760564bf Sep 05 12:39:49.209637 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-1ea184a6-ae73-4b5b-98d5-c4027592c006 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "POST /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/action" status: 202 len: 0 microversion: 2.1 time: 0.447196 Sep 05 12:39:49.210244 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 602/1191] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Sep 5 12:39:48 2022] POST /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:39:49.220341 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-2d5e66d2-c803-41b9-97bf-9b9bc50da830 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:49.221046 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-2d5e66d2-c803-41b9-97bf-9b9bc50da830 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:49.228143 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2d5e66d2-c803-41b9-97bf-9b9bc50da830 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:49.228626 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2d5e66d2-c803-41b9-97bf-9b9bc50da830 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:49.229067 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2d5e66d2-c803-41b9-97bf-9b9bc50da830 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:49.229767 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2d5e66d2-c803-41b9-97bf-9b9bc50da830 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:49.230223 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2d5e66d2-c803-41b9-97bf-9b9bc50da830 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:49.231010 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-2d5e66d2-c803-41b9-97bf-9b9bc50da830 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:49.387691 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-2d5e66d2-c803-41b9-97bf-9b9bc50da830 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:49.396646 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-2d5e66d2-c803-41b9-97bf-9b9bc50da830 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1762 microversion: 2.1 time: 0.182073 Sep 05 12:39:49.397486 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 590/1192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:49 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1762 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:49.635171 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-bd31b0ec-4d4c-4f31-affa-22b2db2fa0f0 req-e97e8d29-a585-459b-ac1d-d4fda666ffbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27934571-ae5b-41c1-a9af-a1bb34972446", "tag": "66006a3c-ea4a-46c9-bbd5-3562760564bf"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:49.645461 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-bd31b0ec-4d4c-4f31-affa-22b2db2fa0f0 req-e97e8d29-a585-459b-ac1d-d4fda666ffbe service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:49.646018 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-bd31b0ec-4d4c-4f31-affa-22b2db2fa0f0 req-e97e8d29-a585-459b-ac1d-d4fda666ffbe service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:49.646453 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-bd31b0ec-4d4c-4f31-affa-22b2db2fa0f0 req-e97e8d29-a585-459b-ac1d-d4fda666ffbe service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:49.658067 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-bd31b0ec-4d4c-4f31-affa-22b2db2fa0f0 req-e97e8d29-a585-459b-ac1d-d4fda666ffbe service nova] Creating event network-changed:66006a3c-ea4a-46c9-bbd5-3562760564bf for instance 27934571-ae5b-41c1-a9af-a1bb34972446 on hv-cinder-85518 Sep 05 12:39:49.663307 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-bd31b0ec-4d4c-4f31-affa-22b2db2fa0f0 req-e97e8d29-a585-459b-ac1d-d4fda666ffbe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031838 Sep 05 12:39:49.664116 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 603/1193] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:40:50.146721 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=3 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:50.147463 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=7 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:50.151595 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9c0f0307-4531-4655-a4f2-8feddf68c61a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:40:50.153749 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9c0f0307-4531-4655-a4f2-8feddf68c61a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:50.160395 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9c0f0307-4531-4655-a4f2-8feddf68c61a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:50.160872 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9c0f0307-4531-4655-a4f2-8feddf68c61a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:50.161305 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9c0f0307-4531-4655-a4f2-8feddf68c61a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:50.161988 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9c0f0307-4531-4655-a4f2-8feddf68c61a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:50.162445 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9c0f0307-4531-4655-a4f2-8feddf68c61a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:50.162868 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9c0f0307-4531-4655-a4f2-8feddf68c61a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:50.230888 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9c0f0307-4531-4655-a4f2-8feddf68c61a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "POST /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/action" status: 202 len: 0 microversion: 2.1 time: 0.085668 Sep 05 12:40:50.231542 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 591/1194] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Sep 5 12:40:50 2022] POST /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:40:50.238591 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=5 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:50.239337 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=11 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:50.244837 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-a4134cf5-d240-41fb-8cad-43ce0c0b3c9a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:50.245569 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-a4134cf5-d240-41fb-8cad-43ce0c0b3c9a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:50.253669 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a4134cf5-d240-41fb-8cad-43ce0c0b3c9a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:50.254150 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a4134cf5-d240-41fb-8cad-43ce0c0b3c9a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:50.254586 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a4134cf5-d240-41fb-8cad-43ce0c0b3c9a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:50.255286 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a4134cf5-d240-41fb-8cad-43ce0c0b3c9a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:50.255767 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a4134cf5-d240-41fb-8cad-43ce0c0b3c9a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:50.256195 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-a4134cf5-d240-41fb-8cad-43ce0c0b3c9a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:50.484424 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-a4134cf5-d240-41fb-8cad-43ce0c0b3c9a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:50.492647 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-a4134cf5-d240-41fb-8cad-43ce0c0b3c9a tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1754 microversion: 2.1 time: 0.256078 Sep 05 12:40:50.501961 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 604/1195] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:50 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1754 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:51.518355 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-5168e686-9ab8-424a-ad36-338f4194684f tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:51.519052 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-5168e686-9ab8-424a-ad36-338f4194684f tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:51.525272 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5168e686-9ab8-424a-ad36-338f4194684f tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:51.525749 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5168e686-9ab8-424a-ad36-338f4194684f tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:51.526190 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5168e686-9ab8-424a-ad36-338f4194684f tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:51.526876 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5168e686-9ab8-424a-ad36-338f4194684f tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:51.527344 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5168e686-9ab8-424a-ad36-338f4194684f tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:51.527812 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-5168e686-9ab8-424a-ad36-338f4194684f tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:51.671781 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-5168e686-9ab8-424a-ad36-338f4194684f tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:51.680260 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-5168e686-9ab8-424a-ad36-338f4194684f tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1759 microversion: 2.1 time: 0.167831 Sep 05 12:40:51.680828 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 592/1196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:51 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:52.704932 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-b5402b3e-d31e-47dc-9e28-d534418200d7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:52.705472 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-b5402b3e-d31e-47dc-9e28-d534418200d7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:52.711912 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b5402b3e-d31e-47dc-9e28-d534418200d7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:52.712390 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b5402b3e-d31e-47dc-9e28-d534418200d7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:52.712820 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b5402b3e-d31e-47dc-9e28-d534418200d7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:52.713502 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b5402b3e-d31e-47dc-9e28-d534418200d7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:52.713954 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b5402b3e-d31e-47dc-9e28-d534418200d7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:52.714380 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-b5402b3e-d31e-47dc-9e28-d534418200d7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:52.856949 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-b5402b3e-d31e-47dc-9e28-d534418200d7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:52.865339 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-b5402b3e-d31e-47dc-9e28-d534418200d7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1759 microversion: 2.1 time: 0.164903 Sep 05 12:40:52.865907 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 605/1197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:52 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:53.890778 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-654c43ac-bf0c-4386-8c9d-d2b0d44d13d4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:53.891399 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-654c43ac-bf0c-4386-8c9d-d2b0d44d13d4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:53.897789 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-654c43ac-bf0c-4386-8c9d-d2b0d44d13d4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:53.898273 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-654c43ac-bf0c-4386-8c9d-d2b0d44d13d4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:53.898717 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-654c43ac-bf0c-4386-8c9d-d2b0d44d13d4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:53.899713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-654c43ac-bf0c-4386-8c9d-d2b0d44d13d4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:53.900170 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-654c43ac-bf0c-4386-8c9d-d2b0d44d13d4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:53.900597 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-654c43ac-bf0c-4386-8c9d-d2b0d44d13d4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:54.036471 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-654c43ac-bf0c-4386-8c9d-d2b0d44d13d4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:54.045703 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-654c43ac-bf0c-4386-8c9d-d2b0d44d13d4 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1759 microversion: 2.1 time: 0.158945 Sep 05 12:40:54.046007 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 593/1198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:53 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1759 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:55.068017 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-110a3931-7682-4b20-8d10-6f621eb2e13c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:55.068620 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-110a3931-7682-4b20-8d10-6f621eb2e13c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:55.075014 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-110a3931-7682-4b20-8d10-6f621eb2e13c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:55.075488 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-110a3931-7682-4b20-8d10-6f621eb2e13c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:55.075950 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-110a3931-7682-4b20-8d10-6f621eb2e13c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:55.076642 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-110a3931-7682-4b20-8d10-6f621eb2e13c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:55.077095 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-110a3931-7682-4b20-8d10-6f621eb2e13c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:55.077519 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-110a3931-7682-4b20-8d10-6f621eb2e13c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:55.217833 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-110a3931-7682-4b20-8d10-6f621eb2e13c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:55.226129 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-110a3931-7682-4b20-8d10-6f621eb2e13c tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1759 microversion: 2.1 time: 0.161968 Sep 05 12:40:55.226693 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 606/1199] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:55 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:56.250269 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-e412e093-2d8a-4dc1-a8c3-d06e433160eb tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:56.250855 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-e412e093-2d8a-4dc1-a8c3-d06e433160eb tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:56.257114 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e412e093-2d8a-4dc1-a8c3-d06e433160eb tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:56.257584 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e412e093-2d8a-4dc1-a8c3-d06e433160eb tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:56.258011 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e412e093-2d8a-4dc1-a8c3-d06e433160eb tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:56.258688 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e412e093-2d8a-4dc1-a8c3-d06e433160eb tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:56.259131 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e412e093-2d8a-4dc1-a8c3-d06e433160eb tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:56.259562 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-e412e093-2d8a-4dc1-a8c3-d06e433160eb tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:56.407178 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-e412e093-2d8a-4dc1-a8c3-d06e433160eb tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:56.415458 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-e412e093-2d8a-4dc1-a8c3-d06e433160eb tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1759 microversion: 2.1 time: 0.169649 Sep 05 12:40:56.416054 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 594/1200] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:56 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:57.439361 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8a0d9db5-dd78-495c-9e39-b1c70a0fbfb7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:57.440042 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8a0d9db5-dd78-495c-9e39-b1c70a0fbfb7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:57.446446 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a0d9db5-dd78-495c-9e39-b1c70a0fbfb7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:57.446930 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a0d9db5-dd78-495c-9e39-b1c70a0fbfb7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:57.447367 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a0d9db5-dd78-495c-9e39-b1c70a0fbfb7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:57.448082 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a0d9db5-dd78-495c-9e39-b1c70a0fbfb7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:57.448538 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a0d9db5-dd78-495c-9e39-b1c70a0fbfb7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:57.448965 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8a0d9db5-dd78-495c-9e39-b1c70a0fbfb7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:57.588176 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-8a0d9db5-dd78-495c-9e39-b1c70a0fbfb7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:57.596928 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8a0d9db5-dd78-495c-9e39-b1c70a0fbfb7 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1759 microversion: 2.1 time: 0.161462 Sep 05 12:40:57.597495 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 607/1201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:57 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:58.619747 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-9373cbaa-c49c-4d44-9a99-2f4a55fa7fd3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:58.620385 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-9373cbaa-c49c-4d44-9a99-2f4a55fa7fd3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:58.629826 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9373cbaa-c49c-4d44-9a99-2f4a55fa7fd3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:58.630244 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9373cbaa-c49c-4d44-9a99-2f4a55fa7fd3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:58.630687 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9373cbaa-c49c-4d44-9a99-2f4a55fa7fd3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:58.631384 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9373cbaa-c49c-4d44-9a99-2f4a55fa7fd3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:58.631874 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9373cbaa-c49c-4d44-9a99-2f4a55fa7fd3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:58.632303 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-9373cbaa-c49c-4d44-9a99-2f4a55fa7fd3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:58.774481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-9373cbaa-c49c-4d44-9a99-2f4a55fa7fd3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:58.783053 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-9373cbaa-c49c-4d44-9a99-2f4a55fa7fd3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1759 microversion: 2.1 time: 0.167193 Sep 05 12:40:58.783636 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 595/1202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:58 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:59.806282 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-3b135cda-e523-4fd5-9299-b29ef0dab1b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:59.806824 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-3b135cda-e523-4fd5-9299-b29ef0dab1b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:59.813819 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3b135cda-e523-4fd5-9299-b29ef0dab1b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:59.814302 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3b135cda-e523-4fd5-9299-b29ef0dab1b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:59.814739 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3b135cda-e523-4fd5-9299-b29ef0dab1b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:59.815425 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3b135cda-e523-4fd5-9299-b29ef0dab1b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:59.815906 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3b135cda-e523-4fd5-9299-b29ef0dab1b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:59.816335 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-3b135cda-e523-4fd5-9299-b29ef0dab1b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:59.960708 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-3b135cda-e523-4fd5-9299-b29ef0dab1b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:59.969087 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-3b135cda-e523-4fd5-9299-b29ef0dab1b3 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1759 microversion: 2.1 time: 0.166844 Sep 05 12:40:59.969652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 608/1203] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:59 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:41:00.992803 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-7800d6b3-b44e-49a7-afde-7153649d65b6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:41:00.993402 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-7800d6b3-b44e-49a7-afde-7153649d65b6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:41:01.000408 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7800d6b3-b44e-49a7-afde-7153649d65b6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:01.000883 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7800d6b3-b44e-49a7-afde-7153649d65b6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:01.001309 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7800d6b3-b44e-49a7-afde-7153649d65b6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:01.001988 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7800d6b3-b44e-49a7-afde-7153649d65b6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:01.002435 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7800d6b3-b44e-49a7-afde-7153649d65b6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:01.002853 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-7800d6b3-b44e-49a7-afde-7153649d65b6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:01.142837 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-7800d6b3-b44e-49a7-afde-7153649d65b6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:41:01.150923 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-7800d6b3-b44e-49a7-afde-7153649d65b6 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1759 microversion: 2.1 time: 0.161995 Sep 05 12:41:01.151493 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 596/1204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:41:00 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:41:02.173727 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-ff0a2332-c2f6-419c-8ad5-e3775b1f7510 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:41:02.174336 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-ff0a2332-c2f6-419c-8ad5-e3775b1f7510 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:41:02.180925 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ff0a2332-c2f6-419c-8ad5-e3775b1f7510 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:02.181401 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ff0a2332-c2f6-419c-8ad5-e3775b1f7510 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:02.181832 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ff0a2332-c2f6-419c-8ad5-e3775b1f7510 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:02.182512 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ff0a2332-c2f6-419c-8ad5-e3775b1f7510 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:02.182959 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ff0a2332-c2f6-419c-8ad5-e3775b1f7510 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:02.183379 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-ff0a2332-c2f6-419c-8ad5-e3775b1f7510 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:02.326774 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-ff0a2332-c2f6-419c-8ad5-e3775b1f7510 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:41:02.335317 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-ff0a2332-c2f6-419c-8ad5-e3775b1f7510 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1762 microversion: 2.1 time: 0.165497 Sep 05 12:41:02.335923 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 609/1205] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:41:02 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1762 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:42:05.789726 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:42:05.790317 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Mon Sep 5 12:42:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/action (ip 10.222.0.16) !!! Sep 05 12:42:05.791951 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 05 12:42:05.795152 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_api:SELECT=12 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:42:05.796556 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG dbcounter [-] [120534] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:42:05.801582 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-cf128633-b102-4c42-94f5-78ed2570e9b1 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1182741039"}} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:42:05.802123 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-cf128633-b102-4c42-94f5-78ed2570e9b1 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:05.814089 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cf128633-b102-4c42-94f5-78ed2570e9b1 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:05.814584 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cf128633-b102-4c42-94f5-78ed2570e9b1 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:05.815072 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cf128633-b102-4c42-94f5-78ed2570e9b1 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:05.815809 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cf128633-b102-4c42-94f5-78ed2570e9b1 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:05.816310 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cf128633-b102-4c42-94f5-78ed2570e9b1 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:05.816744 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-cf128633-b102-4c42-94f5-78ed2570e9b1 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:05.945906 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.network.security_group_api [None req-cf128633-b102-4c42-94f5-78ed2570e9b1 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Removing security group b5ab1468-5300-40dd-9890-5555342b9deb from port 66006a3c-ea4a-46c9-bbd5-3562760564bf Sep 05 12:42:06.242298 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-cf128633-b102-4c42-94f5-78ed2570e9b1 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "POST /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/action" status: 202 len: 0 microversion: 2.1 time: 0.454530 Sep 05 12:42:06.248343 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 597/1206] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Sep 5 12:42:05 2022] POST /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:42:06.253305 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 05 12:42:06.254152 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:42:06.254279 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: Mon Sep 5 12:42:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 05 12:42:06.255326 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_api:SELECT=12 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:42:06.256415 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG dbcounter [-] [120535] Writing DB stats nova_cell1:SELECT=36 {{(pid=120535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:42:06.339566 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-8ac3de1e-a60b-42b2-8a78-216e390c6aec req-f3aa5259-da19-4386-b8ae-bae60767bb7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27934571-ae5b-41c1-a9af-a1bb34972446", "tag": "66006a3c-ea4a-46c9-bbd5-3562760564bf"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:42:06.350956 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-8ac3de1e-a60b-42b2-8a78-216e390c6aec req-f3aa5259-da19-4386-b8ae-bae60767bb7b service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:06.351569 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-8ac3de1e-a60b-42b2-8a78-216e390c6aec req-f3aa5259-da19-4386-b8ae-bae60767bb7b service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:06.352142 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-8ac3de1e-a60b-42b2-8a78-216e390c6aec req-f3aa5259-da19-4386-b8ae-bae60767bb7b service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:06.362887 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-8ac3de1e-a60b-42b2-8a78-216e390c6aec req-f3aa5259-da19-4386-b8ae-bae60767bb7b service nova] Creating event network-changed:66006a3c-ea4a-46c9-bbd5-3562760564bf for instance 27934571-ae5b-41c1-a9af-a1bb34972446 on hv-cinder-85518 Sep 05 12:42:06.367995 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-8ac3de1e-a60b-42b2-8a78-216e390c6aec req-f3aa5259-da19-4386-b8ae-bae60767bb7b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117528 Sep 05 12:42:06.368764 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 610/1207] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:42:07.320833 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-61cc510f-5ebf-489e-9de4-3ea83fde0148 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:07.321351 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-61cc510f-5ebf-489e-9de4-3ea83fde0148 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:07.328119 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61cc510f-5ebf-489e-9de4-3ea83fde0148 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:07.328603 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61cc510f-5ebf-489e-9de4-3ea83fde0148 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:07.329041 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61cc510f-5ebf-489e-9de4-3ea83fde0148 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:07.329728 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61cc510f-5ebf-489e-9de4-3ea83fde0148 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:07.330186 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61cc510f-5ebf-489e-9de4-3ea83fde0148 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:07.330611 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-61cc510f-5ebf-489e-9de4-3ea83fde0148 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:07.412398 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.objects.instance [None req-61cc510f-5ebf-489e-9de4-3ea83fde0148 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lazy-loading 'services' on Instance uuid 27934571-ae5b-41c1-a9af-a1bb34972446 {{(pid=120534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:42:07.490691 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-61cc510f-5ebf-489e-9de4-3ea83fde0148 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/os-volume_attachments/a647d7b9-1366-42d0-af62-c848b75db038" status: 202 len: 0 microversion: 2.1 time: 0.174270 Sep 05 12:42:07.491417 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 598/1208] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Sep 5 12:42:07 2022] DELETE /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/os-volume_attachments/a647d7b9-1366-42d0-af62-c848b75db038 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:42:07.502997 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-8322b763-e5b1-4053-9122-7577bbaaf2c9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:07.505466 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-8322b763-e5b1-4053-9122-7577bbaaf2c9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:07.514012 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8322b763-e5b1-4053-9122-7577bbaaf2c9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:07.514654 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8322b763-e5b1-4053-9122-7577bbaaf2c9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:07.515351 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8322b763-e5b1-4053-9122-7577bbaaf2c9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:07.516076 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8322b763-e5b1-4053-9122-7577bbaaf2c9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:07.516574 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8322b763-e5b1-4053-9122-7577bbaaf2c9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:07.516994 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-8322b763-e5b1-4053-9122-7577bbaaf2c9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:07.550235 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-8322b763-e5b1-4053-9122-7577bbaaf2c9 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053470 Sep 05 12:42:07.550813 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 611/1209] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:42:07 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:42:08.386689 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [req-8bbf3bec-a174-43af-a80c-0c2d0ee55eb0 req-1eab29aa-ee63-49a8-aa15-87710f41087e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27934571-ae5b-41c1-a9af-a1bb34972446", "tag": "66006a3c-ea4a-46c9-bbd5-3562760564bf"}]} {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:42:08.396898 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-8bbf3bec-a174-43af-a80c-0c2d0ee55eb0 req-1eab29aa-ee63-49a8-aa15-87710f41087e service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:08.397372 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-8bbf3bec-a174-43af-a80c-0c2d0ee55eb0 req-1eab29aa-ee63-49a8-aa15-87710f41087e service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:08.397804 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [req-8bbf3bec-a174-43af-a80c-0c2d0ee55eb0 req-1eab29aa-ee63-49a8-aa15-87710f41087e service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:08.409844 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.compute.server_external_events [req-8bbf3bec-a174-43af-a80c-0c2d0ee55eb0 req-1eab29aa-ee63-49a8-aa15-87710f41087e service nova] Creating event network-changed:66006a3c-ea4a-46c9-bbd5-3562760564bf for instance 27934571-ae5b-41c1-a9af-a1bb34972446 on hv-cinder-85518 Sep 05 12:42:08.414570 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [req-8bbf3bec-a174-43af-a80c-0c2d0ee55eb0 req-1eab29aa-ee63-49a8-aa15-87710f41087e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032328 Sep 05 12:42:08.415088 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 599/1210] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:42:08.563132 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-20d1d58c-35cb-4461-906f-9828d633e799 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:08.565444 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-20d1d58c-35cb-4461-906f-9828d633e799 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:08.571449 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-20d1d58c-35cb-4461-906f-9828d633e799 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:08.571961 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-20d1d58c-35cb-4461-906f-9828d633e799 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:08.572394 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-20d1d58c-35cb-4461-906f-9828d633e799 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:08.573081 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-20d1d58c-35cb-4461-906f-9828d633e799 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:08.573534 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-20d1d58c-35cb-4461-906f-9828d633e799 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:08.573957 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-20d1d58c-35cb-4461-906f-9828d633e799 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:08.602728 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-20d1d58c-35cb-4461-906f-9828d633e799 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044317 Sep 05 12:42:08.603297 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 612/1211] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Sep 5 12:42:08 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:42:08.614371 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d75bd6c5-fd69-48bd-b18d-7b47bfce72ff tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:08.614985 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-d75bd6c5-fd69-48bd-b18d-7b47bfce72ff tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:08.621242 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d75bd6c5-fd69-48bd-b18d-7b47bfce72ff tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:08.621717 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d75bd6c5-fd69-48bd-b18d-7b47bfce72ff tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:08.622155 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d75bd6c5-fd69-48bd-b18d-7b47bfce72ff tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:08.622860 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d75bd6c5-fd69-48bd-b18d-7b47bfce72ff tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:08.623880 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d75bd6c5-fd69-48bd-b18d-7b47bfce72ff tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:08.624526 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-d75bd6c5-fd69-48bd-b18d-7b47bfce72ff tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:08.699126 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-d75bd6c5-fd69-48bd-b18d-7b47bfce72ff tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] HTTP exception thrown: Instance 27934571-ae5b-41c1-a9af-a1bb34972446 is not attached to volume a647d7b9-1366-42d0-af62-c848b75db038 Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d75bd6c5-fd69-48bd-b18d-7b47bfce72ff tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Request method failure captured: Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: DELETE /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/os-volume_attachments/a647d7b9-1366-42d0-af62-c848b75db038 HTTP/1.1 Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFe3iTCdmicRcqLLlTDZv-JEpWP8_TAqWJn6Ml6ptST66YD8Ga14u8Ummet3ZZYoNzsxD1g26O0iiaPrrVWj6kKdX0bT7LdsjZAhzcbICf1pL9Gq5TxbGDZ5ejfT5zS9-CQdpDr-fkXhLJLNFx63PTRLOCF7s75UrO74Y__Bzf6lg6MQ Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 7282ae16ef3d42979dfe9616a6b16238 Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-TestMinimumBasicScenario-940707114 Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:42:08.702101 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:42:08.703940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7282ae16ef3d42979dfe9616a6b16238", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7282ae16ef3d42979dfe9616a6b16238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7282ae16ef3d42979dfe9616a6b16238"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7282ae16ef3d42979dfe9616a6b16238"}]}] Sep 05 12:42:08.703940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-TestMinimumBasicScenario-940707114 Sep 05 12:42:08.703940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 7282ae16ef3d42979dfe9616a6b16238 Sep 05 12:42:08.703940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-TestMinimumBasicScenario-940707114 Sep 05 12:42:08.703940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-TestMinimumBasicScenario-940707114-project Sep 05 12:42:08.703940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:42:08.703940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:42:08.703940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: a2556517dad2454c8cbbf26c5a9ea764 Sep 05 12:42:08.703940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-TestMinimumBasicScenario-940707114-project Sep 05 12:42:08.703940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:42:08.703940 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 27934571-ae5b-41c1-a9af-a1bb34972446 is not attached to volume a647d7b9-1366-42d0-af62-c848b75db038 Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'server_id': '27934571-ae5b-41c1-a9af-a1bb34972446', 'id': 'a647d7b9-1366-42d0-af62-c848b75db038'} Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a647d7b9-1366-42d0-af62-c848b75db038. Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:42:08.704935 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27934571-ae5b-41c1-a9af-a1bb34972446 is not attached to volume a647d7b9-1366-42d0-af62-c848b75db038 Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27934571-ae5b-41c1-a9af-a1bb34972446 is not attached to volume a647d7b9-1366-42d0-af62-c848b75db038 Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:42:08.706604 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-d75bd6c5-fd69-48bd-b18d-7b47bfce72ff tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Returning 404 to user: Instance 27934571-ae5b-41c1-a9af-a1bb34972446 is not attached to volume a647d7b9-1366-42d0-af62-c848b75db038 {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:42:08.708108 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-d75bd6c5-fd69-48bd-b18d-7b47bfce72ff tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/os-volume_attachments/a647d7b9-1366-42d0-af62-c848b75db038" status: 404 len: 154 microversion: 2.1 time: 0.093483 Sep 05 12:42:08.708108 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 600/1212] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Sep 5 12:42:08 2022] DELETE /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446/os-volume_attachments/a647d7b9-1366-42d0-af62-c848b75db038 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:42:09.846213 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-21becf90-fe1d-423c-838e-82435f0b6dd0 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:09.846727 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-21becf90-fe1d-423c-838e-82435f0b6dd0 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:09.853173 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21becf90-fe1d-423c-838e-82435f0b6dd0 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:09.853659 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21becf90-fe1d-423c-838e-82435f0b6dd0 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:09.854099 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21becf90-fe1d-423c-838e-82435f0b6dd0 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:09.854786 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21becf90-fe1d-423c-838e-82435f0b6dd0 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:09.855243 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21becf90-fe1d-423c-838e-82435f0b6dd0 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:09.855707 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-21becf90-fe1d-423c-838e-82435f0b6dd0 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:09.879489 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-21becf90-fe1d-423c-838e-82435f0b6dd0 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Going to try to terminate instance {{(pid=120535) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:42:09.953815 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-21becf90-fe1d-423c-838e-82435f0b6dd0 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 204 len: 0 microversion: 2.1 time: 0.111820 Sep 05 12:42:09.954910 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 613/1213] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Sep 5 12:42:09 2022] DELETE /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:42:09.963245 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-102c876f-6591-40c3-839e-998a3d2faf8d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:09.963895 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-102c876f-6591-40c3-839e-998a3d2faf8d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:09.970736 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-102c876f-6591-40c3-839e-998a3d2faf8d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:09.971215 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-102c876f-6591-40c3-839e-998a3d2faf8d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:09.971676 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-102c876f-6591-40c3-839e-998a3d2faf8d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:09.972364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-102c876f-6591-40c3-839e-998a3d2faf8d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:09.972812 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-102c876f-6591-40c3-839e-998a3d2faf8d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:09.973267 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-102c876f-6591-40c3-839e-998a3d2faf8d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:10.101573 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-102c876f-6591-40c3-839e-998a3d2faf8d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:42:10.109310 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-102c876f-6591-40c3-839e-998a3d2faf8d tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1556 microversion: 2.1 time: 0.149981 Sep 05 12:42:10.109861 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 601/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:42:09 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:42:11.133309 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-65412d64-1c7f-43c7-a948-929ad9d24f9b tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:11.134002 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.compute.api [None req-65412d64-1c7f-43c7-a948-929ad9d24f9b tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120535) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:11.141019 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65412d64-1c7f-43c7-a948-929ad9d24f9b tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:11.141490 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65412d64-1c7f-43c7-a948-929ad9d24f9b tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:11.141919 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65412d64-1c7f-43c7-a948-929ad9d24f9b tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:11.142601 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65412d64-1c7f-43c7-a948-929ad9d24f9b tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:11.143046 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65412d64-1c7f-43c7-a948-929ad9d24f9b tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:11.143464 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [None req-65412d64-1c7f-43c7-a948-929ad9d24f9b tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:11.272440 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.policy [None req-65412d64-1c7f-43c7-a948-929ad9d24f9b tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120535) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:42:11.280652 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-65412d64-1c7f-43c7-a948-929ad9d24f9b tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1556 microversion: 2.1 time: 0.151610 Sep 05 12:42:11.281213 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 614/1215] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:42:11 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:42:12.304383 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-81578814-0682-4207-b906-c4c576f52ad2 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:12.305031 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-81578814-0682-4207-b906-c4c576f52ad2 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:12.311829 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-81578814-0682-4207-b906-c4c576f52ad2 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:12.312313 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-81578814-0682-4207-b906-c4c576f52ad2 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:12.312775 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-81578814-0682-4207-b906-c4c576f52ad2 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:12.313459 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-81578814-0682-4207-b906-c4c576f52ad2 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:12.313914 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-81578814-0682-4207-b906-c4c576f52ad2 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:12.314341 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-81578814-0682-4207-b906-c4c576f52ad2 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:12.451104 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.policy [None req-81578814-0682-4207-b906-c4c576f52ad2 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2556517dad2454c8cbbf26c5a9ea764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7282ae16ef3d42979dfe9616a6b16238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120534) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:42:12.458886 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-81578814-0682-4207-b906-c4c576f52ad2 tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 200 len: 1556 microversion: 2.1 time: 0.158460 Sep 05 12:42:12.459488 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 602/1216] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:42:12 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:42:12.858507 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [req-906651f6-05bd-42d1-bbb6-e0ea6812b0f5 req-77c9002f-8304-4f7b-9edf-a27607b81a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27934571-ae5b-41c1-a9af-a1bb34972446", "name": "network-vif-deleted", "tag": "66006a3c-ea4a-46c9-bbd5-3562760564bf"}]} {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:42:12.869842 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-906651f6-05bd-42d1-bbb6-e0ea6812b0f5 req-77c9002f-8304-4f7b-9edf-a27607b81a3f service nova] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:12.870554 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-906651f6-05bd-42d1-bbb6-e0ea6812b0f5 req-77c9002f-8304-4f7b-9edf-a27607b81a3f service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:12.871176 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG oslo_concurrency.lockutils [req-906651f6-05bd-42d1-bbb6-e0ea6812b0f5 req-77c9002f-8304-4f7b-9edf-a27607b81a3f service nova] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:12.883237 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.compute.server_external_events [req-906651f6-05bd-42d1-bbb6-e0ea6812b0f5 req-77c9002f-8304-4f7b-9edf-a27607b81a3f service nova] Creating event network-vif-deleted:66006a3c-ea4a-46c9-bbd5-3562760564bf for instance 27934571-ae5b-41c1-a9af-a1bb34972446 on hv-cinder-85518 Sep 05 12:42:12.889788 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [req-906651f6-05bd-42d1-bbb6-e0ea6812b0f5 req-77c9002f-8304-4f7b-9edf-a27607b81a3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093801 Sep 05 12:42:12.891017 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 615/1217] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Sep 5 12:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:42:13.482401 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-547f90eb-5f2f-4ace-a6ad-d252d4c3e1ef tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '>' {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:13.483478 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.compute.api [None req-547f90eb-5f2f-4ace-a6ad-d252d4c3e1ef tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] [instance: 27934571-ae5b-41c1-a9af-a1bb34972446] Fetching instance by UUID {{(pid=120534) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:13.490199 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-547f90eb-5f2f-4ace-a6ad-d252d4c3e1ef tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:13.490713 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-547f90eb-5f2f-4ace-a6ad-d252d4c3e1ef tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:13.491155 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-547f90eb-5f2f-4ace-a6ad-d252d4c3e1ef tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:13.491891 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-547f90eb-5f2f-4ace-a6ad-d252d4c3e1ef tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Acquiring lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:13.492352 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-547f90eb-5f2f-4ace-a6ad-d252d4c3e1ef tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:13.492783 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG oslo_concurrency.lockutils [None req-547f90eb-5f2f-4ace-a6ad-d252d4c3e1ef tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Lock "b9266b3e-0d18-400e-a40f-fa6d19190a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:13.506934 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.wsgi [None req-547f90eb-5f2f-4ace-a6ad-d252d4c3e1ef tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] HTTP exception thrown: Instance 27934571-ae5b-41c1-a9af-a1bb34972446 could not be found. Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-547f90eb-5f2f-4ace-a6ad-d252d4c3e1ef tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Request method failure captured: Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: request: GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 HTTP/1.1 Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept: application/json Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Accept-Encoding: identity Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Connection: close Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Length: 0 Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Content-Type: application/json Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Host: 10.222.0.16 Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: Openstack-System-Scope: None Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: User-Agent: python-urllib3/1.26.12 Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Auth-Token: gAAAAABjFe3iTCdmicRcqLLlTDZv-JEpWP8_TAqWJn6Ml6ptST66YD8Ga14u8Ummet3ZZYoNzsxD1g26O0iiaPrrVWj6kKdX0bT7LdsjZAhzcbICf1pL9Gq5TxbGDZ5ejfT5zS9-CQdpDr-fkXhLJLNFx63PTRLOCF7s75UrO74Y__Bzf6lg6MQ Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Id: None Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Domain-Name: None Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Identity-Status: Confirmed Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Is-Admin-Project: True Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Id: default Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Domain-Name: Default Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Id: 7282ae16ef3d42979dfe9616a6b16238 Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Project-Name: tempest-TestMinimumBasicScenario-940707114 Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Role: reader,member Sep 05 12:42:13.508481 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Roles: reader,member Sep 05 12:42:13.510246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7282ae16ef3d42979dfe9616a6b16238", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7282ae16ef3d42979dfe9616a6b16238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7282ae16ef3d42979dfe9616a6b16238"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7282ae16ef3d42979dfe9616a6b16238"}]}] Sep 05 12:42:13.510246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant: tempest-TestMinimumBasicScenario-940707114 Sep 05 12:42:13.510246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Id: 7282ae16ef3d42979dfe9616a6b16238 Sep 05 12:42:13.510246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-Tenant-Name: tempest-TestMinimumBasicScenario-940707114 Sep 05 12:42:13.510246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User: tempest-TestMinimumBasicScenario-940707114-project Sep 05 12:42:13.510246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Id: default Sep 05 12:42:13.510246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Domain-Name: Default Sep 05 12:42:13.510246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Id: a2556517dad2454c8cbbf26c5a9ea764 Sep 05 12:42:13.510246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: X-User-Name: tempest-TestMinimumBasicScenario-940707114-project Sep 05 12:42:13.510246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: method: > Sep 05 12:42:13.510246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: exception: Instance 27934571-ae5b-41c1-a9af-a1bb34972446 could not be found. Sep 05 12:42:13.510246 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: action_args: {'id': '27934571-ae5b-41c1-a9af-a1bb34972446'} Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: {{(pid=120534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27934571-ae5b-41c1-a9af-a1bb34972446 could not be found. Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:42:13.511659 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27934571-ae5b-41c1-a9af-a1bb34972446 could not be found. Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27934571-ae5b-41c1-a9af-a1bb34972446 could not be found. Sep 05 12:42:13.513364 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: ERROR nova.api.openstack.wsgi Sep 05 12:42:13.517660 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: DEBUG nova.api.openstack.wsgi [None req-547f90eb-5f2f-4ace-a6ad-d252d4c3e1ef tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Returning 404 to user: Instance 27934571-ae5b-41c1-a9af-a1bb34972446 could not be found. {{(pid=120534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:42:13.517660 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: INFO nova.api.openstack.requestlog [None req-547f90eb-5f2f-4ace-a6ad-d252d4c3e1ef tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446" status: 404 len: 111 microversion: 2.1 time: 0.031416 Sep 05 12:42:13.517660 dv-cinder-855189-1-iscsi devstack@n-api.service[120534]: [pid: 120534|app: 0|req: 603/1218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Sep 5 12:42:13 2022] GET /compute/v2.1/servers/27934571-ae5b-41c1-a9af-a1bb34972446 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:42:13.519395 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: DEBUG nova.api.openstack.wsgi [None req-58ff23e4-525c-4463-8b23-9b84a997ad3e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] Calling method '.version_select at 0x7fba4bbcb430>' {{(pid=120535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:13.540877 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: INFO nova.api.openstack.requestlog [None req-58ff23e4-525c-4463-8b23-9b84a997ad3e tempest-TestMinimumBasicScenario-940707114 tempest-TestMinimumBasicScenario-940707114-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2056506735" status: 202 len: 0 microversion: 2.1 time: 0.025802 Sep 05 12:42:13.541448 dv-cinder-855189-1-iscsi devstack@n-api.service[120535]: [pid: 120535|app: 0|req: 616/1219] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Sep 5 12:42:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2056506735 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)